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CHAPTER  1 

THE  RESEARCH  PROBLEM 

Introduction 

There  is  a  critical  need  for  highly  educated,  compe¬ 
tent  and  professional  contract  managers  who  can  operate 
effectively  in  today's  complex  acquisition  environment  *(42: 

5,  7).  Mr.  Donald  E.  Sowle,  Administrator  for  Federal  Pro¬ 
curement  Policy,  Office  of  Management  and  Budget,  noted: 

As  the  procurement  budget  grows  and  procurements  be¬ 
come  more  complex,  we  need  to  ensure  that  the  work 
force  keeps  pace  both  in  quality  and  quantity.  Pro¬ 
curement  systems  cannot  work  effectively  unless  they 
are  staffed  by  dedicated  professionals  who  can  exer¬ 
cise  proper  initiative  and  judgment  in  making  complex 
and  vital  procurement  decisions  with  the  private 
sector  [42 : 5] . 

This  need  is  even  more  important,  given  the  contemporary  con¬ 
tracting  environment  involving:  1)  dramatic  increases  in 
Federal  budget  funding  for  national  defense;  2)  implementation 
of  recent  Department  of  Defense  (DoD)  initiatives  to  induce 
efficiency  and  stability  in  the  acquisition  process  for  major 
weapon  systems;  and  3)  Congressional  and  DoD  concern  over 
strategies  to  revitalize  an  aging  and  shrinking  defense  indus¬ 
trial  base  (8:54-75;  30:7-13;  48:5.9-5.20). 

Major  General  Joseph  H.  Connolly,  USAF,  Director  of 
Contracting  and  Manufacturing  Policy  (HQ  USAF/RDC) ,  noted  the 
challenge  this  environment  poses  to  the  contracting  community. 


1 


stating : 

The  decade  of  the  eighties  will  mandate  that  the  Air 
Force  contracting  people  develop  new  and  improved 
strategies  for  acquiring  the  weapon  systems  and  other 
supplies  and  services  required  to  strengthen  our 
Nation's  defense  capabilities.  We  will  find  ourselves 
in  a  marketplace  that  is  constantly  fluctuating  as 
national  and  international  events  unfold  [11:2]. 

Public  concern  over  prudent  and  judicious  use  of  avail 
able  tax  dollars  also  dictates  a  need  for  competent,  know¬ 
ledgeable  contract  managers.  Dr.  Joseph  L.  Hood,  Assistant 
Director  for  Training,  Federal  Acquisition  Institute,  stated: 

The  public  is  concerned  about  the  integrity  of  the 
processes  through  which  the  Federal  procurement  expen¬ 
diture  is  made.  The  critical  component  in  the  processes 
concerns  the  competency  of  the  application  of  the 
knowledge  and  skills  possessed  by  personnel  working 
in  the  procurement  offices  [22:8]. 

Statements  by  elected  Government  officials  reflect  public  con 
cern  for  competence  as  well.  In  his  opening  remarks  prior  to 
a  FY83  budget  hearing,  the  Senate  Armed  Services  Committee 
Chairman,  Senator  John  Tower,  noted,  "There  must  be  greater 
emphasis  placed  on  the  accountability  of  this  [Reagan]  admin¬ 
istration,  as  well  as  the  Congress,  for  the  efficient  execu¬ 
tion  of  defense  resources  [28:48]." 

If  contract  managers  are  to  fulfill  the  needs  of  the 
contracting  environment  and  satisfy  public  concern  for  compe¬ 
tence,  a  broad-based  education  in  business  and  management  is 
required  (37:7,  18).  The  reason  stems  from  the  many  require¬ 
ments  placed  upon  the  contract  manager.  Knowledge  of  the 

Defense  Acquisition  Regulation  (DAR) ,  for  example,  is  not 
enough.  Contract  managers  cannot  function  merely  as  clerks 
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safely  following  procedures.  Contract  managers  must:  1) 
possess  the  knowledge  of  product  trends  and  business  methods 
used  by  industries  with  which  they  interact;  2)  be  flexible, 
capable  of  recognizing  situations  where  strict  application  of 
policy  and  procedures  would  not  benefit  the  Government  and 
seek  authority  to  deviate;  3)  be  a  working  partner  among 
other  technical  experts  (engineers,  price  analysts,  data  mana¬ 
gers,  auditors,  and  inspectors)  with  the  right  to  question  and 
influence  requirements  both  in  terms  of  quantity  and  quality; 
and  4)  be  able  to  exercise  sound  judgment  in  evaluating  poten¬ 
tial  contractor  experience,  facilities,  organization,  reputa¬ 
tion,  financial  resources,  and  other  factors  (6:36).  In  short, 
the  contract  manager  must  be  oriented  to  the  political,  econo¬ 
mic,  and  business  environment  in  which  he  or  she  must  operate. 

A  model  depicting  some  of  the  demands  that  this  environment 
places  upon  contract  managers  can  be  seen  in  Fig  1.1  (50:95). 

To  partially  satisfy  the  educational  requirements  of  contract 
managers  functioning  in  this  environment  within  the  Air  Force, 
the  Air  Force  Institute  of  Technology  (AFIT)  School  of  Systems 
and  Logistics  provides  what  is  now  known  as  the  Contracting 
and  Acquisition  Management  (CAM)  graduate  education  program. 

Background 

The  predecessor  to  the  current  CAM  graduate  education 
program  was  created  in  1973,  following  recommendations  of  the 
Commission  on  Government  Procurement  highlighting  the  need  for 
improvement  in  Government-wide  procurement  education  (39:128). 
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Demand  on  Contract  Managers 


The  sponsor  of  the  new  Procurement  Program  was  Brigadier 
General  Robert  F.  Trimble,  then  USAF  Director  of  Procurement 
Policy  under  the  Deputy  Chief  of  Staff  for  Systems  and  Logis¬ 
tics  (31).  The  Procurement  Program  was  located  in  the  Manage¬ 
ment  Sciences  Department  of  the  Graduate  Education  Division 
within  the  AFIT  School  of  Systems  and  Logistics  at  Wright- 
Patterson  AFB ,  Ohio  (31).  Major  Martin  D.  Martin  headed  the 
program  as  Procurement  Major  Program  Coordinator  (31).  A 
Master  of  Science  degree  in  Logistics  Management  with  a  Pro¬ 
curement  Major  was  offered.  In  1974  the  first  graduates  from 
the  Procurement  Program  entered  the  field. 

In  1978  a  concept  study  initiated  by  AFIT  Commandant 
Major  General  Gerald  E.  Cooke  recommended  reorganizing  AFIT 
residence  schools  along  more  functional  lines  (5:86-87).  For 
the  School  of  Systems  and  Logistics,  the  study  recommended 
elimination  of  the  existing  Graduate  Education  and  Continuing 
Education  Divisions  and,  in  their  place,  creation  of  five 
academic  departments:  Contracting  Management,  Logistics 
Management,  Systems  Acquisition  Management,  Organizational 
Sciences,  and  Communication  and  Humanities.  This  recommenda¬ 
tion  was  implemented  in  1979.  Along  with  the  creation  of  the 
Department  of  Contracting  Management,  the  title  of  the  Pro¬ 
curement  graduate  education  program  changed  to  the  Contracting 
and  Acquisition  Management  (CAM)  option  ( 3 : A- 30) .  The  degree 
offered  was  a  Master  of  Science  in  Logistics  Management  with 
Contracting  and  Acquisition  Management  major.  The  option 
name  was  recently  changed  to  Contracting  and  Manufacturing 
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Management  to  correspond  with  the  sponsor's  title  change, 
Director  of  Contracting  and  Manufacturing  Policy  (HQ  USAF/RDC) . 
To  date,  approximately  150  military  and  civilian  contract 
managers  have  graduated  from  the  program  (9) . 

Purpose  of  the  Research 

A  critical  element  of  any  educational  program  is  the 
measurement  of  its  usefulness  (50:96).  The  basis  of  this  re¬ 
search  was  to  measure  the  usefulness  of  the  AFIT  CAM  program. 
One  measure  of  program  usefulness  was  based  on  the  utility  of 
the  AFIT  CAM  curriculum  as  perceived  by  its  graduates  and 
their  supervisors.  The  outcome  of  this  research  was  the 
development  of  a  feedback  system  based  on  perceptions  from  the 
field.  This  system  may  be  viewed  as  a  model  of  AFIT  CAM  pro¬ 
gram  educational  usefulness  (see  Figure  1.2). 

In  Figure  1.2,  inputs  to  the  AFIT  CAM  program  origi¬ 
nated  from  a  broad  spectrum  of  Air  Force  Commands  as  well  as 
other  services  and  Federal  agencies.  Through  the  educational 
process  (i.e.,  the  AFIT  CAM  curriculum),  these  inputs  were 
transformed  into  outputs  (contract  managers)  to  be  utilized 
in  the  various  DoD  commands  and  Federal  agencies.  A  measure 
of  AFIT  CAM  program  usefulness  was  developed  by  obtaining 
feedback  from  those  graduates  who  had  experienced  the  gradu¬ 
ate  education  process.  Furthermore,  a  measure  of  AFIT  CAM 
program  usefulness  from  graduates  and  supervisors  aided  in 
current  management  of  the  AFIT  CAM  program. 
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INPUTS  PROCESS  OUTPUTS 


Measure 

Fig  1.2.  Model  of  AFIT  CAM  Usefulness 

Problem  Statement 

A  measurement  of  AFIT  CAM  program  usefulness  from  the 
viewpoint  of  its  graduates  and  their  supervisors  did  not 
exist.  As  a  result,  it  was  not  known  how  well  the  AFIT  CAM 
program  has  achieved  established  educational  goals  nor  how 
well  the  AFIT  CAM  program  has  been  managed  since  its  incep¬ 
tion.  Furthermore,  a  demographic  profile  of  AFIT  CAM  gradu¬ 
ates  did  not  exist.  This  profile  was  needed  to  establish  an 
AFIT  CAM  graduate  feedback  network  to  aid  in  future  curriculum 
development  and  overall  program  management  decisions. 
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Research  Questions  and  Supporting  Hypotheses 
In  order  to  obtain  solutions  to  the  problem  statement, 
the  following  research  questions  were  analyzed: 

1.  What  are  the  perceptions  of  active  duty  Air  Force 
military  and  civilian  AFIT  CAM  graduates  and  their 
supervisors  regarding  the  usefulness  of  a  graduate 
AFIT  CAM  education  in  postgraduate  assignments? 

2.  What  is  the  demographic  profile  of  active  duty  Air 
Force  military  and  civilian  AFIT  CAM  graduates? 

3.  What  are  the  most/least  useful  subject  areas  in  the 
AFIT  CAM  curriculum  as  perceived  by  active  duty  Air 
Force  military/civilian  graduates  and  their  supervisors? 
The  specific  qualitative  research  hypotheses  developed 

to  answer  Research  Question  One  were: 

1.  Active  duty  Air  Force  military  and  civilian  AFIT  CAM 
graduates  perceive  the  AFIT  CAM  program  as  not  useful 
in  postgraduate  assignments. 

2.  Supervisors  of  active  duty  Air  Force  military  and  civil¬ 
ian  AFIT  CAM  graduates  perceive  the  AFIT  CAM  program 

as  not  useful  to  their  subordinates  in  postgraduate 
assignments . 

3.  There  is  no  significant  difference  between  active 
duty  Air  Force  military  and  civilian  AFIT  CAM  gradu¬ 
ates'  and  their  supervisors'  perceptions  of  AFIT  CAM 
program  usefulness. 

4.  Active  duty  Air  Force  military  and  civilian  AFIT 
CAM  graduates*  perceptions  of  AFIT  CAM  program 
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usefulness  do  not  change  over  time. 

There  were  no  research  hypotheses  associated  with  Research 
Question  Two  due  to  the  nature  of  demographic  data.  A  quali¬ 
tative  assessment  of  collected  information  was  provided  to 
aid  in  future  AFIT  CAM  program  management  decisions.  Research 
Question  Three  was  answered  by  ranking  the  median  scores  of 
Likert  scale  responses  from  AFIT  CAM  graduates  regarding  the 
most/least  useful  subject  areas  in  the  AFIT  CAM  curriculum. 

Justification 

Feedback  from  the  user's  standpoint  was  necessary  to 

verify  the  educational  benefits  of  the  AFIT  CAM  program. 

Zemansky  and  Gordon  noted  that 

Educational  institutions  need  the  help  of  practicing 
purchasing  (contract)  managers  who  recognize  their 
obligation  to  aid  in  the  educational  process  and  in 
redefining  the  curriculum  to  make  it  relevant,  current 
and  effective  [50:96]. 

Several  research  studies  measuring  the  usefulness  of  a  gradu¬ 
ate  education  received  at  the  AFIT  School  of  Systems  and 
Logistics  have  previously  been  accomplished  (10;  13;  15;  20; 
21;  25;  29).  However,  no  research  had  been  conducted  which 
measured  feedback  on  the  usefulness  of  an  AFIT  CAM  education 
in  postgraduate  assignments.  Furthermore,  this  research  was 
of  interest  and  practical  importance  to: 

1.  The  Air  Force  Director  of  Contracting  and  Manu¬ 
facturing  Policy,  Major  General  Joseph  H.  Connolly, 
sponsor  of  the  AFIT  CAM  program. 

2.  The  AFIT  CAM  Option  Coordinator,  Captain  Donald  L. 
Brechtel . 
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3.  The  graduate  faculty  of  the  Department  of 
Contracting  Management. 

General  Research  Plan 

The  general  research  plan  concentrated  on  the  percep¬ 
tions  of  AFIT  CAM  graduates  and  supervisors  regarding  useful¬ 
ness  of  the  program.  The  vehicles  for  obtaining  these  per¬ 
ceptions  were  two  attitudinal  surveys.  The  surveys  were 
divided  into  the  following  three  parts:  Demographic,  Percep¬ 
tions,  and  Open-Ended  Response  questions.  Six  of  the 
perception  questions  were  assigned  to  each  of  the  research 
hypotheses  associated  with  Research  Question  One.  Nonpara- 
metric  statistical  tests  were  utilized  to  measure  the  percep¬ 
tions  of  graduates  and  supervisors  to  evaluate  each  of  the 
research  hypotheses.  The  demographic  questions  in  the  survey 
instruments  were  used  to  answer  Research  Question  Two.  Finally, 
the  remaining  perception  questions  and  the  open-ended  questions 
were  used  in  conjunction  with  Research  Question  Three. 

Key  Definitions 

It  is  important  to  define  several  key  terms  used  fre¬ 
quently  throughout  this  research  in  order  to  form  a  common 
frame  of  reference. 

1.  Usefulness  -  The  quality  or  state  of  being  useful; 
conduciveness  to  an  end;  utility  (19:986).  In  the  context  of 
this  research,  a  graduate's  AFIT  CAM  education  is  useful  if 
it  is  of  practical  use  in  job  performance.  This  definition 
of  usefulness  was  incorporated  in  the  structure  of  questions 
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in  the  questionnaire. 


2.  Contract  Manager  -  The  term  "contract  manager"  as 
used  in  this  research  includes  the  entire  gamut  of  individuals 
working  in  the  Air  Force  Specialty  Code  (AFSC)  65XX  as  well 

as  Government  civilians  in  the  1100/1200  series.  The  func¬ 
tions  of  contract  managers  as  used  in  this  research  include, 
but  are  not  limited  to:  requirements  generation,  contract 
planning,  negotiations,  contract  award,  production/manufac¬ 
turing,  quality  assurance,  contract  modifications,  purchasing, 
contract  administration,  and  contract  closeout.  Thus,  the 
term  "contract  manager"  covers  a  broad  spectrum  of  functional 
jobs  related  to  Government  procurement  (40:19-32). 

3.  Procurement  -  Purchasing,  renting,  leasing,  or 
otheritfise  obtaining  supplies  or  services;  includes  all  func¬ 
tions  related  to  obtaining  supplies  and  services,  including 
description  (but  not  determination)  of  requirements,  selec¬ 
tion  and  solicitation  of  sources,  preparation  and  award  of 
contracts,  and  all  phases  of  contract  administration  (16:542,. 

4.  Acquisition  -  Acquiring  supplies  or  services  by 
contract  with  appropriated  funds  by  and  for  the  use  of  the 
Federal  Government  through  purchase,  lease,  or  barter,  whether 
the  supplies  or  services  are  already  in  existence  or  must  be 
created,  developed,  demonstrated,  or  evaluated;  includes  con¬ 
tract  definition,  product  development,  test  and  evaluation, 
procurement,  production,  and  deployment/installation  (16:11). 
For  the  purposes  of  this  research,  the  term  "acquisition" 
encompasses  the  term  "procurement." 
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Overview  of  the  Study 


This  research  project  is  reported  in  five  chapters. 
Chapter  1  has:  1)  introduced  the  need  for  contract  manager 
education  and  provided  background/origins  of  the  AFIT  CAM 
program;  2)  stated  the  purpose/ justi fication  for  the  research 
including  the  research  problem,  the  research  questions,  and 
qualitative  hypotheses;  and  3)  outlined  the  general  research 
plan  and  defined  key  terms.  Chapter  2,  Literature  Review, 
will:  1)  provide  an  in-depth  review  of  the  legislative  his¬ 

tory  and  formation  of  Federal  agencies  related  to  Government 
procurement  education;  2)  orient  the  reader  to  the  existing 
availability  of  Government-wide  procurement  education;  and 
3)  review  previous  AFIT  graduate  research  efforts  and  other 
pertinent  information  on  the  usefulness  of  various  education¬ 
al  programs.  Chapter  3,  Research  Methodology,  will:  1)  dis¬ 
cuss  the  construction  of  the  research  questionnaire;  2)  vali¬ 
date  questions  used  to  measure  graduate  and  supervisor  percep¬ 
tions  of  AFIT  CAM  program  usefulness;  and  3)  discuss  statisti¬ 
cal  tests  to  be  employed  in  analysis  of  the  data.  Chapter  4, 
Data  Analysis,  will  address  the  three  research  questions  and 
analyze  the  results  from  questionnaires  issued  to  the  target 
population  using  the  methodology  developed  in  Chapter  3. 
Chapter  5,  Summary,  Conclusions,  and  Recommendations,  will: 

1)  synthesize  research  findings  and  state  implications  of  the 
research;  and  2)  propose  recommendations  for  future  research 
in  the  area  of  educational  usefulness. 
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CHAPTER  2 


LITERATURE  REVIEW 
Background 

The  origin  of  graduate  education  programs  specializing 
in  Federal  acquisition  began  with  the  legislative  history 
creating  the  Commission  on  Government  Procurement  (COGP) .  On 
January  3,  1969,  Representative  Chet  Holifield  introduced  a 
House  Bill,  H.R.  474,  proposing  creation  of  a  Government  com¬ 
mission  to  conduct  a  comprehensive  review  and  study  of  Federal 
Government  procurement  policies  and  practices  (6:166-167).  A 
companion  bill  in  the  Senate,  S.1707,  quickly  followed  and 
was  introduced  by  Senator  Henry  Jackson  (6:167).  Testimony 
of  procurement  specialists  from  Government  and  industry  be¬ 
fore  the  Military  Operations  Subcommittee  on  Government 
Operations  supported  formation  of  a  commission  for  this  pur¬ 
pose  (6:167).  As  a  result,  Congress  passed  Public  Law  91-129, 
which  established  the  COGP  (44:139). 

The  purpose  of  the  COGP  was  to  study  and  investigate: 

1)  existing  statutes  affecting  Government  procurement;  2) 
procurement  policies,  rules,  regulations,  procedures  and 
practices  followed  by  all  organizations  in  the  Executive 
branch  of  the  Government;  and  3)  the  procurement  organizations 
themselves  (6:168).  The  COGP  received  thousands  of  pages  of 
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procurement  reports,  Congressional  testimony  and  documents; 
consulted  approximately  12,000  people  engaged  in  procurement; 
conducted  more  than  2,000  meetings  at  over  1,000  Government, 
industry,  and  academic  facilities;  received  responses  to 
questionnaires  from  nearly  60,000  individuals  affected  by 
Government  procurement  (44 : vii- viii) .  The  COGP  completed 
this  exhaustive  study  in  December  1972,  and  presented  149 
recommendations  to  the  Congress  (44:185-199).  The  five-volume, 
ten-part  Report  of  the  Commission  on  Government  Procurement 
affected  "virtually  every  aspect  of  procurement  from  policy 
to  statute  and  from  acquisition  of  major  systems  to  acquisi¬ 
tion  of  commercial  products  [6:171]."  The  Report  affected 
procurement  education  as  well.  This  was  particularly  evident 
in  the  COGP  Recommendations  1,  15,  16,  and  21. 

COGP  Recommendation  1  proposed  the  establishment  of  a 
central  Office  of  Federal  Procurement  Policy  (OFPP)  to  solve 
procurement  problems  caused  by  "the  lack  of  central  executive 
branch  leadership  in  developing  policy  and  effectively  main¬ 
taining  ongoing  procurement  operations  [44:12]."  It  states: 

Establish  by  law  a  central  Office  of  Federal  Procure¬ 
ment  Policy  in  the  Executive  Office  of  the  President, 
preferably  in  the  Office  of  Management  and  Budget, 
with  specialized  competence  to  take  the  leadership 
in  procurement  policy  and  related  matters.  .  .  [44:9]. 

Congress  passed  Public  Law  93-400  on  August  30,  1974,  formally 

establishing  the  OFPP  within  the  Office  of  Management  and 

Budget  (18 : 19) . 

Among  the  many  intended  functions  proposed  for  the  new 
OFPP  was  its  task  to: 
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develop  and  promote  programs  for  the  upgrading  of 
procurement  personnel,  including  recruitment,  train¬ 
ing,  career  development,  and  standards  of  performance 
and  the  conduct  and  sponsorship  of  research  in  pro¬ 
curement  policy  and  procedures  [44:13]. 

This  task  was  carried  out  by  an  OFPP  Administrator,  a  position 

established  under  Section  5(b)  of  Public  Law  93-400.  Section 

6(d)  of  this  law  describes  the  Administrator's  functions  (45: 

905).  Two  OFPP  Administrator  functions  relate  directly  to 

Government-wide  procurement  education: 

(1)  Promoting  and  conducting  research  in  procurement 
policies,  regulations,  procedures,  and  forms. 

(2)  Recommending  and  promoting  programs  of  the  Civil 
Service  Commission  and  executive  agencies  for 
recruitment,  training,  career  development,  and 
evaluation  of  procurement  personnel  [45:905-906], 

The  significance  of  these  functions  may  be  seen  from  the  com¬ 
ments  made  in  the  Legislative  History  of  the  U.S.  Code  (46: 
4601)  : 

This  function  (promoting  research)  was  to  provide  OFPP 
with  the  wherewithal  to  avoid  the  formulation  and  pro¬ 
mulgation  of  procurement  policies  and  regulations 
without  hard  facts  achieved  through  comprehensive  re¬ 
search  or  operating  experience.  The  provision  would 
foster  innovation  and  creativity  and  would  permit 
orderly  development  of  promising  procurement  tech¬ 
niques  before  committing  large  sums  of  money. 

This  provision  (programs  for  recruiting  and  training) 
recognizes  that  lasting  improvements  in  the  procure¬ 
ment  process  can  only  be  achieved  with  personal 
programs  designed  to  equip  the  procurement  work  force 
to  cope  with  the  increasingly  complex  demands  of  con¬ 
temporary  buying. 

Two  other  COGP  recommendations  affected  Government-wide 
procurement  education  programs;  in  particular,  Recommendations 
15  and  16  (44:186) . 

Recommendation  15.  Assign  to  the  Office  of  Federal 
Procurement  Policy  responsibility  for:  (a)  Developing 
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and  monitoring,  in  cooperation  with  the  procuring 
agencies  and  the  Civil  Service  Commission,  personnel 
management  programs  that  will  assure  a  competent  work 
force.  (b)  Defining  agency  responsibilities  and  estab¬ 
lishing  standards  for  effective  work  force  management 
and  for  development  of  a  Government-wide  personnel 
improvement  program.  (c)  Developing  and  monitoring  a 
uniform  data  information  system  for  procurement 
personnel . 

Recommendation  16.  Establish  a  recruiting  and  trainee 
program  to  assure  development  of  candidates  for  procure¬ 
ment  positions  in  all  agencies,  at  all  levels,  and  in 
all  required  disciplines.  Special  attention  should  be 
given  to  college  recruitment  to  obtain  young  workers 
capable  of  being  trained  through  experience  and  addi¬ 
tional  formal  education  to  provide  the  managerial  staff 
required  a  decade  from  now. 

Recommendations  15  and  16  reflected  COGP  concern  that  no  single 
source  could  identify  how  many  people  were  engaged  in  procure¬ 
ment,  what  skills  were  necessary,  or  how  such  skills  were 
being  provided  (44:46).  Furthermore,  no  agencies  possessed 
long-range  plans  for  recruitment  and  training  of  procurement 
personnel.  This  existed  despite  the  fact  that  one- fourth 
of  the  procurement  work  force  was  eligible  for  retirement 
within  five  years  at  the  conclusion  of  the  study;  one-half 
the  work  force  was  eligible  to  retire  within  ten  years  (44: 

46).  The  COGP  also  determined  that:  1)  agency  recruitment 
programs  were  largely  based  on  reaction  to  impending  changes 
in  current  workload  rather  than  forecasted  workload  or  poten¬ 
tial  losses;  2)  only  small  numbers  of  college  graduates  were 
being  placed  in  the  procurement  work  force;  and  3)  only  about 
half  of  the  agencies  visited  during  the  study  conducted  for¬ 
mal  intern  or  trainee  programs;  most  of  these  did  not  provide 
a  well-balanced  or  comprehensive  approach  (44:48). 

It  is  in  COGP  Recommendation  21,  however,  that  the  need 
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for  graduate  education  programs  specializing  in  Government 

procurement  became  most  apparent. 

Recommendation  21.  Establish  a  Federal  Procurement 
Institute  which  would  include  undergraduate  and  gradu¬ 
ate  curricula,  procurement  research  programs,  execu¬ 
tive  seminar  programs,  and  other  academic  programs 
[44:51]. 

The  COGP  determined  that 

existing  schools,  courses,  and  formal  education  pro- 
grams--some  of  which  are  excellent- -do  not  adequately 
provide  the  special  training  needed  to  sustain  the 
highly  competent  procurement  work  force  required  to 
handle  the  major  contracting  efforts  of  the  Government 
[44:51]. 

Moreover,  existing  schools  and  programs  of  instruction  in  pro¬ 
curement  were  found  to  vary  significantly  from  one  agency  to 
another  (44:51).  No  school  or  program  was  dedicated  solely 
for  the  purpose  of  upgrading  procurement  education  throughout 
the  Government;  all  existing  schools  had  broader  missions  in¬ 
volving  teaching  of  courses  other  than  procurement  (44:52). 

The  COGP  felt  that  the  existing  fragmentation  of  procurement 
training  resulted  in:  1)  redundant  training  efforts;  2)  voids 
in  curriculum,  particularly  with  respect  to  the  management 
level;  and  3)  problems  with  the  currency  of  course  offerings 
(44:52) . 

As  a  result.  Recommendation  21  proposed  establishment 
of  the  Federal  Procurement  Institute  (FPI)  to  assume  central¬ 
ized  responsibility  in  providing  training,  performing  research, 
and  charged  with  the  general  advancement  of  the  field  (39:118). 
In  the  field  of  research,  the  proposed  FPI  would  (44:52): 

Conduct  and  sponsor  research  in  procurement  policy  and 
procedure . 
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Establish  and  maintain  a  central  reporting  and  research 
library  in  the  field  of  Federal  procurement  and  grants. 

Offer  a  program,  similar  to  Sloan  Fellowships,  for 
Federal  and  industry  personnel  providing  a  period  of 
study  and  research  at  the  Institute  or  related  insti¬ 
tutions  . 

Maintain  a  liaison  with  professional  organizations; 
participate  in  intergovernmental  and  international  pro¬ 
curement  conferences  and  related  activities. 

In  the  field  of  education,  FPI  would  (44:53): 

Formulate  comprehensive  education  and  training  plans  in 
cooperation  with  all  agencies. 

Monitor  education  and  training  efforts  throughout 
Government,  industry,  and  the  academic  community,  to 
include  studies  of  the  appropriateness  and  adequacy  of 
such  efforts. 

Sponsor  and  publish  studies  and  research  materials  re¬ 
lating  to  education  for  procurement  operations  and 
management . 

Sponsor  training  for  the  faculties  of  schools  instruct¬ 
ing  in  procurement  and  related  subjects. 

Assist  universities  that  wish  to  develop  bachelor  degree 
programs  in  the  field  of  procurement. 

Develop  and  conduct  executive  seminar  programs  in  pro¬ 
curement,  available  to  State  and  local  governments  and 
to  contractor  personnel. 

Develop  and  conduct  executive  seminar  programs  for  pro¬ 
curement  management  personnel. 

Pursuant  to  the  COGP  recommendations  published  in  Decem¬ 
ber  1972,  an  Interagency  Task  Group  was  convened  to  analyze 
the  feasibility  of  establishing  a  Federal  Procurement  Insti¬ 
tute  (39:118).  The  Interagency  Task  Group  made  their  final 
report  in  July  1974,  and  acknowledged  the  need  for  the  FPI. 

In  1976,  the  FPI  was  established  within  the  Department  of 
Defense  which  was  its  initially  assigned  executive  agency  (27: 
56).  In  1978,  the  Federal  Procurement  Institute  was  renamed 
the  Federal  Acquisition  Institute  (FAI)  (26:23).  As  a  result 
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of  Public  Law  96-83,  the  Office  of  Federal  Procurement  Policy 
Act  Amendment  of  1979,  the  FAI  became  an  integral  part  of  a 
different  executive  agency,  the  Office  of  Management  and  Bud¬ 
get,  where  it  remains  today  (24:6). 

The  goals  of  today's  FAI  remain  basically  the  same  as 

when  the  Institute  was  created.  The  FAI  is 

responsible  for  recommending  and  promoting  programs  for 
recruitment,  training,  career  development,  and  perform¬ 
ance  evaluation  of  procurement  personnel  to  improve  the 
overall  performance  and  professional  stature  of  the 
procurement  workforce  [24:6]. 

As  a  means  of  achieving  this  goal,  the  FAI  is  actively  engaged 

in  promoting  educational  programs  to  develop  professionalism 

in  the  procurement  career  field  (23:7).  In  this  role,  the 

FAI  acts  as  a  high-level  project  office,  planning  educational 

programs  and  working  with  the  military  services,  colleges,  and 

universities  to  carry  out  the  program.  The  FAI  attempts  to 

pull  together,  streamline,  and  economize  the  diverse 
procurement  training  and  education  programs  now  offered 
by  various  federal  agencies  in  order  to  meet  the  needs 
of  both  the  procurement  manager  and  the  individual 
procurement  professional  [27:57]. 

The  FAI  does  not  replace,  duplicate,  or  assume  control  of 
agency  programs.  FAI  fulfills  the  need  for  coordination  and 
leadership  in  planning,  implementing,  and  evaluating  agency 
and  Government-wide  programs.  This  goal  is  especially  chal¬ 
lenging,  given  the  wide  and  diverse  field  of  procurement 
education  that  is  available  to  contract  managers. 
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Acquisition  Education 

Acquisition  education  for  contract  managers  is  avail¬ 
able  from  a  wide  variety  of  sources,  both  internal  and  exter¬ 
nal  to  the  Government.  Taken  as  a  whole,  these  educational 
resources  offer  contract  managers  an  opportunity  to  expand 
both  their  knowledge  and  skills  in  the  specific  yet  diverse 
field  of  acquisition.  The  Federal  Acquisition  Institute  gives 
high  priority  to  education  programs  in  its  quest  for  increased 
productivity,  performance,  and  above  all,  professionalism 
within  the  acquisition  workforce  (7:5). 

The  spectrum  of  acquisition  education  available  to  con¬ 
tract  managers  is  wide  in  scope.  The  methods  available  for 
obtaining  this  knowledge  are  just  as  diverse.  Raisters  (38: 
91)  categorized  eight  methods  through  which  an  individual  can 
obtain  the  necessary  education  in  the  acquisition  field. 

These  eight  methods  are  represented  in  Figure  2.1  (38:97). 
Raisters  stated  that  formal  academic  programs  werd  the  best 
and  quickest  method  available  to  obtain  an  acquisition  educa¬ 
tion  (38:105).  However,  Raisters  stated  that  professional 
organization  seminars  and  workshops  and  Government  agency  pro¬ 
grams  also  served  as  excellent  sources  of  acquisition  educa¬ 
tion  (38:100) . 

The  core  of  formal  acquisition  education  programs  can 
be  broken  down  into  four  major  categories:  acquisition  and 
contracting;  legal;  financial;  and  related  skills  (39:123). 
Acquisition  and  contracting  is  concerned  with  topics  related 
to  the  contracting,  procurement,  purchasing,  and  acquisition 
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functions.  The  legal  category  covers  the  business,  commer¬ 
cial  and  contract  law  fields,  including  patents  and  royalties, 
technical  data,  claims,  disputes,  and  terminations.  The 
financial  category  involves  the  area  of  pricing  and  cost  ana¬ 
lysis  relative  to  contract  proposal  preparation,  negotiation, 
settlements,  and  cost  accounting  standards.  Related  fields 
of  study  include  program  management,  project  management, 
logistics  management,  economics,  the  quality  function,  and 
data  processing. 

Over  250  colleges  and  universities  conduct  formal  edu¬ 
cation  programs  in  acquisition  and  related  subjects  (35).  A 
majority  of  these  schools,  however,  do  not  offer  enough  in¬ 
struction  to  constitute  a  major  or  minor  field  of  study  in 
purchasing  or  contracting  for  a  college  degree  candidate  (36: 
13).  The  Federal  Acquisition  Institute  is  currently  working 
on  this  problem  by  attempting  to  establish  a  common  body  of 
knowledge  for  the  acquisition  career  field.  FAI ’ s  overall 
objective  is  to  establish  continuing  education,  associate, 
baccalaureate,  graduate  degree,  and  certificate  programs  in 
colleges  and  universities  near  major  work  force  centers  in 
the  United  States  (23:7). 

Professional  organizations  in  the  field  of  acquisition 
also  provide  valuable  educational  programs  to  contract  mana¬ 
gers  by  offering  speaker  programs,  special  seminars,  and  work¬ 
shops  (38:100).  These  activities  provide  an  arena  or  forum 
where  the  latest  professional  information  is  disseminated, 
changed,  and  adapted.  Professional  organizations  also  conduct 
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certification  programs  to  recognize  and  insure  competence 
among  contract  managers.  Three  such  programs  are:  1)  the 
Certified  Purchasing  Manager  (CPM)  offered  by  the  National 
Association  of  Purchasing  Management;  2)  the  Certified  Pro¬ 
fessional  Contracts  Manager  (CPCM)  program  conducted  by  the 
National  Contract  Management  Association;  and  3)  the  Certi¬ 
fied  Public  Purchasing  Official  (CPPO)  program  offered  under 
the  joint  auspices  of  the  National  Institute  of  Governmental 
Purchasing  and  the  National  Association  of  State  Purchasing 
Officials  (50:97) . 

Government- sponsored  acquisition  educational  programs 
are  yet  another  valuable  source  of  education  for  contract  mana¬ 
gers.  On  the  civilian  side  of  Government  acquisition,  three 
significant  schools  are  in  existence:  1)  the  U.S.  Civil  Ser¬ 
vice  Commission,  Bureau  of  Training,  Management  Sciences  Train¬ 
ing  Center,  Washington  D.C.;  2)  the  Federal  Supply  Service, 
General  Services  Administration,  Interagency  Branch,  Arlington, 
Virginia;  and  3)  the  Graduate  School,  U.S.  Department  of  Agri¬ 
culture,  Washington  D.C.  (39:123,  125).  The  bulk  of  Government- 
sponsored  acquisition  education  programs,  however,  are 
situated  within  the  Department  of  Defense  (39:123).  Most  of 
the  courses  offered  are  short  courses  of  six  to  eight  hours 
per  day  of  a  one-week  to  ten-day  duration.  In  general,  these 
schools  are  limited  to  military  or  civilian  personnel  from 
Federal  agencies,  Congressional  staffers,  state  and  local 
governments,  and  a  small  number  of  foreign  students  (39:123). 
Significant  DoD- sponsored  schools  offering  acquisition 
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education  are:  1)  the  U.S.  Army  Logistics  Management  Center 
(ALMC) ,  Fort  Lee,  Virginia;  2)  the  U.S.  Naval  Material  Com¬ 
mand  (NAVMAT) >  Arlington,  Virginia;  3)  the  U.S.  Army  Manage¬ 
ment  Education  and  Training  Agency  (AMETA) ,  Rock  Island, 
Illinois;  4)  the  Air  Training  Command  (ATC)  Technical  Train¬ 
ing  Center,  Lowry  AFB ,  Denver,  Colorado;  5)  the  Naval  Post¬ 
graduate  School,  Monterey,  California;  6)  the  Defense  Systems 
Management  College  (DSMC) ,  Fort  Belvoir,  Virginia;  and  7)  the 
Air  Force  Institute  of  Technology  (AFIT) ,  School  of  Systems 
and  Logistics,  Wright- Patterson  AFB,  Ohio  (14:12-13;  39:124- 
125;  47:263).  Only  two  of  these  schools  offer  graduate  degree 
programs  with  a  concentration  in  contracting  and  acquisition 
management.  The  Naval  Postgraduate  School  offers  a  graduate- 
level  Acquisition  and  Contract  Management  curriculum;  the  Air 
Force  Institute  of  Technology  (AFIT)  offers  a  graduate- level 
Contracting  and  Acquisition  Management  curriculum  (7:115;  14: 
12). 

Within  the  DoD,  there  are  essentially  three  levels  of 
contracting  and  acquisition  that  require  education  and  train¬ 
ing  on  a  continuous  basis:  base,  central,  and  systems- level 
acquisition.  Base-level  contracting  is  local  in  nature.  It 
is  the  acquisition  of  materiel  or  services  by  an  installation 
for  consumption  at  th  .*  installation  or  its  satellite  activi¬ 
ties  (16:546).  Central  contracting  is  consolidated  procure¬ 
ment  covering  the  requirements  of  two  or  more  ordering  agen¬ 
cies;  it  is  the  "process  of  acquiring  material  to  meet 
consolidated  department-wide  requirements  [16:546]." 


24 


Systems- level  contracting  relates  more  to  the  acquisition  of 
weapon  systems  and  supporting  equipment  (16:11).  The  DoD 
services,  as  well  as  other  Government  agencies,  conduct  con¬ 
tracting  operations  at  each  of  these  three  levels  of  contract¬ 
ing  and  acquisition  management. 

Figure  2.2  illustrates  the  interrelationships  among 
the  various  levels,  sources,  and  users  of  acquisition  educa¬ 
tion.  For  example,  the  Air  Force  Institute  of  Technology 
(AFIT)  Contracting  and  Acquisition  Management  (CAM)  program 
offers  the  various  users  a  sys terns  -  level ,  graduate  education 
program  originating  from  Governmental  educational  sources.  A 
different  example  is  the  AFIT  Education  With  Industry  (EWI) 
program  which  offers  a  program  option  with  concentration  in 
contracting  and  manufacturing  (1:176).  This  EWI  option  also 
provides  the  Air  Force  with  a  systems- level  acquisition  edu¬ 
cation  for  contract  managers,  but  instead  utilizes  private 
education  and  training  sources.  It  is  a  ten-month,  non¬ 
degree  internship  with  defense  contractors  that  provides  Air 
Force  officers  with  a  unique  view  of  the  corporate  side  of 
weapon  system  acquisition. 

The  AFIT  Contracting  and  Acquisition  Management  (CAM) 
and  Education  With  Industry  (EWI)  programs  are  only  two  of  the 
many  educational  programs  offered  through  AFIT.  Each  program 
lies  within  AFIT's  much  broader  educational  mission.  Since 
it  is  the  AFIT  CAM  program  that  is  the  focus  of  this  research, 
it  is  now  necessary  to  trace  its  functional  location  within 
AFIT  as  well  as  a  detailed  description  of  the  program's 
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Fig  2.2.  Acquisition  Education  Cube 
purpose  and  curriculum. 


AFIT 

The  Air  Force  Institute  of  Technology  (AFIT),  located 
at  Wright-Patterson  AFB ,  Ohio,  is  a  component  of  Air  Univer¬ 
sity  within  the  Air  Training  Command.  AFIT's  mission  is  "to 
provide  education  to  meet  Air  Force  requirements  in  scienti¬ 
fic,  technological,  managerial,  medical,  and  other  fields  as 
directed  by  HQ  USAF  [1:2,  4]."  AFIT  provides  education  pro¬ 
grams  through  the  School  of  Engineering,  School  of  Civil 
Engineering,  School  of  Systems  and  Logistics,  and  Civilian 
Institution  Program  (1:4).  All  but  the  Civilian  Institution 
Program  are  taught  in  residence  at  Wright-Patterson  AFB.  Of 
relevant  interest  to  this  research  project  is  the  School  of 
Systems  and  Logistics.  This  AFIT  School  conducts  the 
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Contracting  and  Acquisition  Management  (CAM)  graduate  educa¬ 
tion  program. 

AFIT  School  of  Systems 
and  Logistics' 

The  AFIT  School  of  Systems  and  Logistics  is  the  Air 

Force  center  for  education  and  research  programs  related  to 

management  of  a  variety  of  defense  systems  (1:114).  The 

School  of  Systems  and  Logistics  has  three  broad  missions: 

to  provide  educational  programs,  research,  and 
consultative  services  concerned  with  managing  de¬ 
fense,  civil  engineering,  logistics,  and  systems 
programs  and  activities  [1:115] . 

The  School  of  Systems  and  Logistics  provides  programs  and  ser¬ 
vices  developed  and  conducted  in  response  to  Department  of 
Defense  (DoD)  and  Air  Force  requirements.  Three  educational 
programs  are  offered:  the  Graduate  Management  Program,  Pro¬ 
fessional  Continuing  Education  Program,  and  Correspondence 
Course  Program  (1:115). 

The  primary  purpose  of  the  School  of  Systems  and  Logis¬ 
tics  Graduate  Management  Program  is  to  provide  selected  gradu¬ 
ate  military  and  civilian  managers  with  an  education  designed 
to  enhance  their  ability  to  effectively  analyze,  design,  and 
manage  complex  defense  systems  in  order  to  meet  Air  Force  and 
DoD  needs  in  the  area  of  Civil  Engineering  Management,  Logis¬ 
tics  Management,  and  Systems  Management  (1:117).  The  educa¬ 
tional  objectives  of  the  School's  Graduate  Management  Program 
are  to  help  students: 

1.  Apply  systems  theory  to  the  analysis  of  complex 
problems  and  decision  situations; 
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2.  Conduct  research  in  solving  problems  and  making 
decisions  concerned  with  the  management  of  complex 
systems ; 

3.  Apply  fundamental  concepts  and  techniques  of 
descriptive  and  inferential  statistics  to  problem 
analysis  and  decision-making  under  conditions  of 
uncertainty  and  risk; 

4.  Use  fundamental  management  science  concepts  and 
techniques  to  improve  problem  analysis  and  decision¬ 
making  effectiveness; 

5.  Communicate  effectively,  both  orally  and  in 
writing ; 

6.  Apply  basic  concepts  and  techniques  of  organiza¬ 
tion  theory  and  behavior  relevant  to  managing 
complex  organizations; 

7.  Apply  management  information  systems  concepts 
to  effectively  support  the  decision-making  struc¬ 
ture  and  processes  in  a  complex  organization; 

8.  Apply  basic  concepts  and  techniques  of  economic 
analysis,  financial  management,  and  accounting  in 
acquiring  and  controlling  the  financial  resources  to 
support  the  operations  of  a  complex  organization; 

9.  Describe  and,  where  appropriate,  apply  fundamen¬ 
tal  concepts  and  techniques  for  acquiring/providing 
products  or  services  by  contract; 

10.  Evaluate  systems  for  the  effective  and  efficient 
production  and  distribution  of  those  goods  and  ser¬ 
vices  an  organization  provides  its  customers;  and 

11.  Integrate  and  apply  concepts  and  techniques 
acquired  in  all  of  the  course  work  included  in  a 
particular  curriculum  to  the  analysis  and  develop¬ 
ment  of  organization  policy  [2], 

Three  fully- accredited  Graduate  Management  Programs 
lead  to  the  award  of  the  Master  of  Science  degree:  the  Gradu¬ 
ate  Engineering  Management  Program,  Graduate  Systems  Manage¬ 
ment  Program,  and  Graduate  Logistics  Management  Program  (1: 
115).  All  graduate  programs  are  fifteen  months  in  duration. 
The  Graduate  Engineering  Management  Program  provides  civil 
engineering  officers  with  a  graduate  educational  program 
designed  to  improve  their  effectiveness  in  managing  civil 
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engineering  activities.  The  Graduate  Systems  Management  Pro¬ 
gram  provides  students  from  various  systems,  research  and 
development,  engineering,  and  analysis  career  fields  with  a 
graduate  educational  program  designed  to  improve  their  effec¬ 
tiveness  in  managing  programs  for  which  they  will  be  respon¬ 
sible.  The  Graduate  Systems  Management  Program  offers  majors 
in  Engineering  Management,  Research  and  Development  Management 
and  Systems  Management.  The  Graduate  Logistics  Management 
Program  provides  students  from  various  logistics  career  fields 
with  a  graduate  educational  program  designed  to  improve  their 
effectiveness  in  managing  a  variety  of  logistics  systems  and 
related  programs.  The  degree  is  offered  with  majors  in  Acqui¬ 
sition  Logistics  Management,  Logistics  Management,  International 
Logistics  Management,  Maintenance  Management,  and  Contracting 
and  Acquisition  Management.  Figure  2.3  briefly  summarizes  the 
functional  location  of  the  Contracting  and  Acquisition  Manage¬ 
ment  (CAM)  option  within  the  educational  hierarchy  of  AFIT  and 
the  Air  Training  Command. 

In  response  to  its  educational  mission,  the  School  of 
Systems  and  Logistics  is  also  responsible  for  developing  Pro¬ 
fessional  Continuing  Education  and  Extension  Correspondence 
Institute  courses.  The  Professional  Continuing  Education 
(PCE)  program  offers  courses  designed  to  provide  educational 
opportunities  for  practicing  logisticians  and  systems  managers 
(1:115).  Courses  are  developed  and  modified  as  required  to 
meet  the  changing  educational  needs  in  the  operational  agen¬ 
cies  of  DoD,  Air  Force,  and/or  the  major  commands.  Courses 
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are  conducted  in  residence  or  on-site  in  both  the  United  States 
and  overseas.  The  School  is  also  responsible  for  preparing 
texts  and  manuscripts  used  by  the  Extension  Course  Institute 
(1:115).  These  instructional  materials  are  used  for  teaching 
PCE  courses  in  residence  or  on-site. 

The  second  mission  of  the  School  of  Systems  and  Logis¬ 
tics  is  to  provide  research  focusing  on  the  management  of 
various  defense  engineering,  logistics,  research  and 
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development,  and  systems  programs  and  activities  (1:115).  In 
general,  the  research  is  accomplished  through  either  graduate 
thesis  research  or  faculty  research.  Students  in  the  respec¬ 
tive  graduate  management  programs  are  required  to  conduct 
research  and  write  a  thesis  on  significant  problems  or  issues 
of  concern  to  managers  in  career  fields  related  to  the  student’s 
major  program  of  study.  The  primary  purpose  of  the  thesis  re¬ 
search  is  to  provide  the  student  with  a  practical  and  realistic 
opportunity  to  integrate  and  apply  the  concepts  and  techniques 
acquired  in  the  various  courses  defining  the  student's  parti¬ 
cular  curriculum.  As  a  product  of  the  student  thesis  program, 
the  Air  Force  receives  valuable  research  which  would  otherwise 
be  purchased  by  contract  or  consume  other  in-house  services. 

The  School  of  Systems  and  Logistics  faculty  also  conducts  inde¬ 
pendent  research  into  problems  and  issues  of  interest  to  defense 
logistics,  engineering,  and  research  and  development  managers. 
Results  and  recommendations  are  published  as  technical  reports 
and  are  made  available  to  concerned  agencies  in  the  DoD 
community. 

The  third  mission  of  the  School  of  Systems  and  Logistics 
is  to  provide  consultative  services  in  the  management  of  defense 
engineering,  logistics,  and  research  and  development  systems 
and  programs  (1:116).  In  this  consultant  capacity,  the  faculty 
of  the  School  assists  requesting  agencies  with  the  analysis  and 
resolution  of  real-world  problems  by  applying  the  latest  and 
most  appropriate  management  technology.  Having  discussed  the 
mission  of  AFIT,  the  School  of  Systems  and  Logistics,  and  the 
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functional  location  of  the  AFIT  Contracting  and  Acquisition 
Management  (CAM)  program,  the  mission  and  curriculum  of  the 
AFIT  CAM  program  is  reviewed  in  the  following  section. 

AFIT  CAM 

The  AFIT  CAM  program  comes  under  the  direction  of  the 
Department  of  Contracting  Management,  one  of  five  academic 
departments  within  the  School  of  Systems  and  Logistics.  Other 
academic  departments  are:  Logistics  Management,  Organization 
Sciences,  Communication  and  Humanities,  and  System  Acquisi¬ 
tion  Management  (1:119).  The  Department  of  Contracting  Manage¬ 
ment  develops  and  administers  both  graduate  and  professional 
continuing  education  courses  concerned  with  theoretical  and 
applied  aspects  of  contracting  management  (1:116).  The 
department's  Graduate  Management  Program  in  Contracting  and 
Acquisition  Management  (CAM)  is  designed  to  "prepare  students 
to  assume  a  managerial  role  in  the  contracting  community  [1: 
118]."  The  AFIT  CAM  program  provides  students  with  a  systems 
perspective  in  the  overall  logistics  field  and  a  strong  foun¬ 
dation  in  quantitative  methods  and  management  concepts, 
particularly  relevant  to  contracting  and  acquisition  manage¬ 
ment.  The  School  of  Systems  and  Logistics  FY81  Annual  Evalu¬ 
ation  Report  further  states: 

The  general  objective  of  this  [CAM]  option  is  to  pro¬ 
vide  graduates  with  the  knowledge  and  skills  necessary 
to  specify,  evaluate,  and  manage  the  human,  financial, 
material,  and  contractual  resources  they  will  direct 
in  future  assignments  as  middle  and  upper  level  mana¬ 
gers  in  the  contracting  management  career  field.  In 
addition  to  providing  the  students  with  a  systems 
perspective  of  the  overall  logistics  field,  special 
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courses  permit  the  student  to  investigate  areas  of 
contracting  and  acquisition  in  greater  depth  [4:140]. 


The  Contracting  and  Acquisition  Management  Major  is 
conducted  in  six  academic  sessions.  The  first  four-week 
session  provides  intensive  review  courses  in  mathematics, 
accounting,  and  computers.  The  first  four-week  session  is 
followed  by  five  eleven-week  graduate  quarters.  The  AFIT  CAM 
graduate  program  is  fifteen  months  in  duration.  AFIT  Pamph¬ 
let  53-20  succinctly  describes  the  AFIT  CAM  curriculum: 

The  graduate  curriculum  for  the  Contracting  and 
Acquisition  Management  major  consists  of  11  integrated 
core  courses,  four  specially  designed  contracting 
courses,  two  elective  courses,  plus  12  hours  of  thesis 
study.  The  core  courses  extend  students'  knowledge 
and  understanding  of  quantitative  methods,  logistics 
interrelationships,  and  management  concepts.  The 
special  courses  permit  students  to  investigate  areas 
of  contracting  in  greater  depth.  Electives  are  de¬ 
signed  to  broaden  students'  interests  or  to  provide 
in-depth  study  in  a  specific  area.  Theses  topics 
typically  address  current  contracting  and  acquisition 
management  problems  and  provide  the  opportunity  to 
conduct  practical  research.  Many  theses  topics  are 
provided  by  DOD/USAF  agencies  interested  in  sponsor¬ 
ing  student  research.  The  curriculum  for  the  Contract¬ 
ing  and  Acquisition  Management  major  is  listed  below 
in  the  sequence  offered: 

Review  Term 

Elements  of  Financial  and  Cost  Accounting 
Introduction  to  Computers 
Quantitative  Methods  for  Managers 
Research  Orientation 

Qtr  I  (Summer] 

Federal  Financial  Management 
Economic  Analysis  and  Public  Policy 
Applied  Statistics  for  Managers  I 
Quantitative  Decision-Making 

Qtr  II  (Fall] 

Contracting  and  Acquisition  Management 
Research  and  Technical  Writing 
Applied  Statistics  for  Managers  II 
Management  and  Behavior  in  Organizations 
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Qtr  III  (Winter) 

Cost  and  Price  Theory 

Maintenance  and  Production  Management 

International  Logistics  Management 

Elective 

Thesis  Proposal 

Qtr  IV  (Spring) 

Legal  Aspects  of  Contracting 
Distribution  Management 
Independent  Study  (Thesis) 

Elective 

Short  Term 

Independent  Study  (Thesis) 

Qtr  V  (Summer) 

Contract  Management  Theory 
Seminar  in  Acquisition  Management 
Independent  Study  (Thesis)  [2] 


Related  Research 


The  purpose  of  this  research  effort  was  the  measure¬ 
ment  of  AFIT  CAM  program  usefulness  as  perceived  by  its  gradu¬ 
ates  and  their  supervisors.  While  no  previous  research 
related  directly  to  the  authors'  research  problem,  seven  AFIT 
graduate  student  theses  relate  indirectly  to  this  research 
project.  In  general,  all  of  these  previous  research  efforts 
measured  various  alumni  perceptions  of  the  AFIT  School  of 
Systems  and  Logistics.  Thus,  these  earlier  research  efforts 
were  similar  in  approach,  yet  different  in  focus.  A  review  of 
these  relevant  studies  highlights  other  approaches  to  a  simi¬ 
lar  problem. 

In  1965  Lieutenant  Colonel  Allan  C.  Hart  conducted  a 
study  concerned  with  the  utilization  of  education  received  at 
the  School  of  Systems  and  Logistics,  the  extent  to  which  the 
course  objectives  were  met,  and  the  evaluation  of  the 
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curriculum  (21:7).  A  hypothesis  test  approach  was  used  to 
analyze  data  collected  from  questionnaires  distributed  to 
1963  and  1964  graduates.  Hart  concluded  that  the  "Graduate 
Logistics  Program  fulfilled  the  role,  mission,  and  objectives 
for  which  it  was  designed  [21:57]." 

In  1968  Second  Lieutenants  Robert  Cook  and  John  E. 

Greene  examined  the  value  of  the  existing  School  of  Systems 
and  Logistics  curriculum  relative  to  the  needs  of  practition¬ 
ers  in  the  field  (15:4).  A  survey  instrument  was  used  to 
solicit  data  from  graduates  of  the  School  in  the  1965-1967 
year  groups.  Cook  and  Greene  concluded  that  the  School  of 
Systems  and  Logistics  taught  subjects  which  graduates  both 
need  and  use  in  the  field  (13:95). 

In  1971  Captains  Terry  W.  Hale  and  Basil  E.  Rooney 
performed  a  related  study  which  measured  the  importance  of 
education  in  management  performance  (20:1).  A  questionnaire 
was  developed  to  test  the  hypothesis  that  "graduates  of  the 
Graduate  Logistics  Management  Program  perform  their  managerial 
responsibilities  better  than  comparable  officers  without  a 
graduate  education  [20:12]."  Hale  and  Rooney  concluded  that 
the  performance  of  graduates  was  superior  to  non-graduates  in 
five  of  nine  areas,  which  included  decision-making,  perform¬ 
ance,  planning,  communications,  and  overall  education  (20:40- 
41). 

In  1972  Captains  Joseph  E.  Latt  and  Rick  Harrelson  studied 
the  image  of  the  School  of  Systems  and  Logistics  as  perceived 
by  senior  logistics  managers  (29:1).  Using  a  questionnaire 
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for  data  collection,  Latt  and  Harrelson  determined  that  the 
School  and  its  graduates  were  highly  regarded  by  logistics 
managers  in  the  field  (29:41). 

In  1978  Captains  William  N.  Crowder  and  James  A. 

Davidson  conducted  research  on  the  usefulness  of  the  School 
of  Systems  and  Logistics  graduate  education  program  as  per¬ 
ceived  by  graduates  and  their  supervisors  (15:9).  A  question¬ 
naire  was  sent  to  graduates  of  the  School  who,  in  turn, 
hand-carried  a  similarly  designed  second  questionnaire  to 
their  respective  supervisors.  The  year  groups  surveyed  were 
classes  1971-1975.  Crowder  and  Davidson  concluded  that  gradu¬ 
ates  felt  the  School  of  Systems  and  Logistics  Graduate  Manage¬ 
ment  Program  was  useful;  however,  supervisors  felt  the  program 
was  even  more  useful  than  did  graduates  (15:57-58).  An  additional 
conclusion  was  that  graduates  felt  they  could  be  better  uti¬ 
lized  in  positions  other  than  those  they  currently  held  (15: 

58)  . 

In  1979  Captains  Kenneth  R.  Brown  and  David  M. 
Hollingsworth  conducted  another  study  "to  determine  the  extent 
to  which  graduates  of  the  AFIT  School  of  Systems  and  Logistics 
have  used  the  knowledge  obtained  from  their  graduate  education 
in  follow-on  assignments  [10:10]."  Supporting  objectives  were: 

1)  to  analyze  the  possibility  of  enhanced  promotion  potential 
resulting  from  an  AFIT  education;  and  2)  to  determine  and 
analyze  overall  usefulness  of  AFIT  graduate  management  educa¬ 
tion  as  perceived  by  alumni  (10:10).  Brown  and  Hollingsworth 
considered  an  AFIT  Graduate  Management  Program  education 


useful  if  it  was  perceived  as  having  practical  use  in  the 
graduate's  job  performance  (10:18).  Questionnaires  were  used 
to  survey  graduates  from  classes  1963-1978.  Several  conclu¬ 
sions  were  reached  (10:57-59): 

1.  Graduates  believed  their  chances  in  promotions 
increased  as  a  result  of  attending  AFIT. 

2.  Graduates  felt  an  AFIT  Graduate  Management  Pro¬ 
gram  education  was  personally  useful  as  well  as 
useful  to  the  Air  Force. 

3.  Graduates  perceived  their  supervisors  having 
favorable  opinions  of  the  AFIT  programs. 

4.  In  general,  graduates  believed  the  AFIT  Graduate 
Management  Program  curriculum  was  useful  in  their 
job. 

5.  Graduates  often  felt  their  education  was  under¬ 
utilized  in  terms  of  job  assignments  received 
following  graduation. 

In  1980  Major  Grantland  W.  Johns  and  Captain  Philip  M. 
Ray  compared  the  usefulness  of  the  AFIT  Facilities  Management 
Program  in  the  School  of  Systems  and  Logistics  with  similar 
programs  in  civilian  institutions.  Perceptions  of  program 
usefulness  were  solicited  from  both  AFIT  resident  and  civilian 
institution  graduates.  A  questionnaire  was  used  to  solicit 
response  of  83  officers  from  the  Facilities  Management  Program 
and  50  officers  from  similar  programs  at  civilian  institutions. 
Johns  and  Ray  concluded  that  both  programs  were  useful,  but 
that  the  AFIT  Graduate  Facilities  Management  residence  program 
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was  more  advantageous  for  officers  due  to  its  Air  Force 
orientation  (25:52-58). 

In  summary,  the  majority  of  previous  research  pertains 
to  AFIT  educational  usefulness,  but  only  at  the  School  of 
Systems  and  Logistics  level.  Only  Johns  and  Ray  pursued  edu¬ 
cational  usefulness  research  at  an  individual  graduate  educa¬ 
tion  program  level.  Nonetheless,  a  review  of  all  these 
efforts  was  productive.  In  particular,  the  research  efforts 
of  Crowder/Davidson  and  Brown/Hollingsworth  were  instrumental 
in  designing  the  research  methodology  for  this  research 
effort. 


CHAPTER  3 


RESEARCH  METHODOLOGY 

Overview 

In  Chapter  1,  the  researchers  defined  the  basic  prob¬ 
lem  and  formulated  research  questions  and  hypotheses.  This 
chapter  outlines  the  procedures  utilized  in  answering  the 
questions  raised  by  this  research  effort.  The  researchers 
defined  the  graduate  and  supervisor  samples  of  interest, 
developed  a  survey  questionnaire  to  gather  coded  data,  and 
described  statistical  tests  and  descriptive  analyses  to  be 
performed  based  on  the  level  of  data  gathered  by  this  research. 
Finally,  the  assumptions  and  limitations  of  this  research 
effort  are  presented. 


Population 

Survey  participants  were  selected  from  two  target  popu¬ 
lations:  1)  current  active  duty  Air  Force  officers  and  DoD 

civilians  who  have  completed  the  graduate  AFIT  Contracting 
and  Acquisition  Management  (CAM)  program  since  its  inception; 
and  2)  the  graduates'  immediate  supervisors  (i.e.,  rating 
officials  for  military/performance  appraisal  officials  for 
civilians).  The  total  Air  Force  military/civilian  CAM  gradu¬ 
ate  population  consisted  of  153  people,  of  which  110  were 
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still  on  active  duty  at  the  time  this  research  study  was 
accomplished.  Only  selected  members  of  the  1974B  through 
1981J  classes  (inclusive)  were  surveyed.  Several  categories 
of  graduates  and  supervisors  were  excluded  from  participation 
in  this  research  project.  These  categories  and  the  rationale 
for  their  exclusion  are  as  follows: 

1 .  Supervisors  of  AFIT  CAM  graduates  who  were  not 
presently  assigned  in  the  Contracting  Career  Field 
(65XX) .  The  skills  learned  in  the  AFIT  CAM  pro¬ 
gram  may  not  be  required  in  other  USAF  positions 
and,  hence,  responses  by  these  supervisors  could 
bias  the  research  results. 

2.  Other  Military  Service  Students.  The  researchers 
were  unable  to  locate  these  graduates  due  to  time 
and  other  resource  constraints. 

3.  Present  AFIT  Faculty.  Due  to  their  familiarity 
with  this  research  effort  and  the  subject  area, 
AFIT  graduates  who  presently  serve  on  the  AFIT 
faculty  and  their  supervisors  were  excluded  from 
this  research  to  prevent  potential  bias  to  the 
research  results. 

4.  Retired  Students  and  Other  Students  Separated  from 
the  Air  Force.  The  researchers  could  not  locate 
these  AFIT  CAM  graduates  due  to  time  and  other  re¬ 
source  constraints. 

The  two  resulting  samples  represent  an  incomplete  census  of 
all  graduates  of  the  AFIT  CAM  program  and  the  graduates’ 
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immediate  supervisors.  However,  due  to  the  descriptive  nature 
of  this  research,  these  samples  were  sufficient  in  measuring 
usefulness  of  the  AFIT  CAM  program  to  the  target  population. 

As  a  consequence,  the  research  results  applied  only  to  the  two 
respondent  groups  of  graduates  and  supervisors.  Inferences  to 
the  overall  AFIT  CAM  graduate  population,  and  their  supervisors, 
concerning  usefulness  of  the  AFIT  CAM  program  were  neither 
attempted  nor  implied. 

After  defining  the  target  populations,  questionnaires 
were  mailed  to  105  graduates  and  their  immediate  supervisors. 

In  order  to  maintain  complete  anonymity  among  all  participants, 
no  attempt  was  made  to  pair  the  responses  of  graduates  with 
the  responses  of  their  respective  supervisors. 

The  Survey  Instrument 

General 

After  considering  several  data  gathering  techniques, 
the  researchers  determined  that  a  mailed  questionnaire  would 
best  satisfy  the  needs  of  this  research  effort.  In  making 
this  determination,  a  wide  geographical  dispersion  of  the 
survey  participants  was  an  overriding  concern.  There  were 
several  advantages  to  using  a  mailed  questionnaire,  including 
lower  cost  per  individual  contacted  and  the  ability  to  find 
individuals  who  might  otherwise  be  inaccessible.  Furthermore, 
the  mailed  questionnaire  allowed  respondents  extra  time  to 
consider  choices  and  make  responses  that  most  accurately  re¬ 
flect  their  views  (17:283). 
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For  this  research  effort,  the  mailed  questionnaire  was 
the  only  logical  choice.  With  respect  to  this  decision,  Emory 
identified  several  disadvantages  in  the  use  of  a  mailed  ques¬ 
tionnaire  (17:283).  First,  there  is  usually  a  strong  bias  of 
nonresponse  and,  as  a  result,  the  researchers  have  little  con¬ 
trol  over  the  response  rate.  Second,  there  is  a  limit  to  the 
amount  and  type  of  information  obtained  via  a  mailed  question¬ 
naire.  Survey  participation  tends  to  decline  as  the  question¬ 
naire  becomes  more  complex.  A  general  rule  of  thumb  is  that 
respondents  should  be  able  to  answer  the  entire  questionnaire 
in  ten  minutes  (17:283). 

Emory  noted  that  the  better  educated  respondents  and 
those  survey  participants  more  interested  in  the  topic  tend 
to  answer  mailed  questionnaires  (17:283).  Since  the  graduate 
AFIT  CAM  population  is  highly  educated  and  population  members 
have  attended  the  program  of  research  interest,  the  research¬ 
ers  believed  that  non-response  bias  would  be  low.  Further¬ 
more,  the  relatively  short  graduate  survey  consisted  of  68 
multiple  choice  questions  and  two  short- answer  free  response 
questions  (refer  to  Appendix  A) .  The  response  time  required 
for  supervisors  to  answer  the  survey  instrument  was  a  serious 
concern  of  the  researchers.  In  order  to  overcome  the  non¬ 
response  bias  of  supervisors,  the  survey  instrument  for 
supervisors  consisted  of  only  44  multiple  choice  and  two 
short-answer  free  response  questions  (refer  to  Appendix  B) . 
This  questionnaire  design  prevented  the  survey  from  becoming 
a  burden  on  the  supervisors'  time. 
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A  basic  premise  of  this  research  was  the  guarantee  of 
survey  participants'  anonymity.  The  purpose  of  the  anonymity 
guarantee  was  to  relieve  the  survey  participants'  concern  that 
candid  and  honest  answers  would  affect  their  professional 
careers  (15:15).  One  consequence  of  the  anonymity  guarantee 
was  the  researchers'  inability  to  determine  the  identities  of 
survey  non- respondents .  This  made  impossible  any  attempt  to 
accomplish  a  follow-up  mailing  to  reduce  non-response.  The 
researchers  made  a  concerted  effort,  however,  to  stimulate 
responses  through  careful  design  and  execution  of  the  survey 
instruments  (17:283;  15:16). 

The  survey  instruments  identified  in  Appendices  A  and 
B  are  a  synthesis  of  several  previous  research  efforts  (10; 

11;  15).  The  researchers  modified  the  instruments  used  in 
the  previous  research  efforts  in  order  to  focus  specifically 
on  the  graduate  AFIT  CAM  program.  The  resulting  survey  in¬ 
struments  have  the  validity  gained  from  previous  research 
efforts  as  well  as  validation  by  experts  in  the  field  of  con¬ 
tract  management  and  research  survey  development  (9;  34;  49). 

Questionnaire  Structure 

In  order  to  canvas  AFIT  CAM  graduates  and  their  super¬ 
visors,  two  separate  questionnaires  were  used.  The  structure 
of  the  two  questionnaires  was  very  similar.  Each  questionnaire 
contained  three  sections.  The  first  section,  Demographics, 
was  used  to  gather  demographic  data  on  both  populations. 
Questions  1-25  in  the  graduate  survey  (see  Appendix  A)  were 
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used  to  answer  Research  Question  Two  concerning  the  demogra¬ 
phic  profile  of  AFIT  CAM  graduates.  The  demographic  data 
provided  the  basis  for  a  variety  of  numerical  tables  that 
accurately  described  AFIT  CAM  graduate  respondents. 

Questions  1-4  in  the  supervisor  survey  (see  Appendix 
B)  provided  limited  demographic  data  but,  more  importantly, 
satisfied  three  other  research  requirements.  First,  an 
answer  of  "yes"  (a)  on  Question  1  alerted  the  researchers 
that  one  supervisor  questionnaire  would  be  submitted  for 
several  AFIT  CAM  graduates  under  his/her  supervision.  Second, 
an  answer  of  "no"  (b)  on  Question  2  invalidated  the  entire 
questionnaire.  Third,  an  answer  of  "yes"  (a)  on  Question  3 
identified  the  participant  as  both  an  AFIT  CAM  graduate  and  a 
supervisor. 

The  second  section  of  both  graduate  and  supervisor  sur¬ 
vey  instruments,  the  Perceptions  section,  measured  attitudinal 
perceptions  of  AFIT  CAM  graduates  and  their  supervisors  regard¬ 
ing  usefulness  of  the  AFIT  CAM  program.  These  two  sections 
constituted  the  essential  portion  of  the  data  collection 
design.  Questions  within  the  Perceptions  section  of  each  sur¬ 
vey  instrument  fell  into  the  following  categories: 

1.  Usefulness  of  the  AFIT  CAM  program  as  perceived  by 
graduates  (see  Appendix  A--Questions  26-30,  62, 
and  64-66)  and  supervisors  (see  Appendix  B-- 
Questions  5-9  and  42) .  These  specific  survey 
questions  were  utilized  in  answering  Research 
Question  One  as  well  as  all  four  of  the  qualitative 
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research  hypotheses  outlined  in  Chapter  1. 

2.  The  applicability  of  the  AFIT  CAM  curriculum  to 
the  duties  performed  by  graduates  in  follow-on 
assignments.  This  applicability  was  measured  by 
perceptions  of  graduates  (see  Appendix  A--Questions 
31-61,  63,  and  68)  and  supervisors  (see  Appendix  B 
--Questions  10-41,  and  43).  These  specific  ques¬ 
tions  were  utilized  in  answering  Research  Question 
Three . 

The  only  difference  between  the  questions  on  the  graduates' 
and  supervisors'  questionnaires,  as  identified  in  categories 
1  and  2  above,  was  a  minor  wording  change  to  accommodate  the 
two  different  viewpoints.  Three  questions  in  the  Perceptions 
section  of  the  graduate  survey  were  not  replicated  in  the 
supervisor  survey  due  to  the  nature  of  the  questions  (see 
Appendix  A- -Questions  64-66). 

Questions  67  on  the  graduate  survey  and  44  on  the  super¬ 
visor  survey  were  utilized  in  conjunction  with  the  open-ended 
response  questions  in  the  third  section  of  the  survey  instru¬ 
ment.  These  questions  were  used  to  determine  if  AFIT  CAM 
graduates  and  their  supervisors  believed  that  incorporation 
of  contracting- related  AFIT  Professional  Continuing  Education 
(PCE)  courses  into  the  existing  AFIT  CAM  curriculum  would  be 
beneficial. 

The  third  and  final  section  of  each  of  the  survey  in¬ 
struments  contained  two  open-ended  questions  concerning  miscel¬ 
laneous  subjects  of  interest  to  the  AFIT  CAM  Option  Coordinator 
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and  the  AFIT  Department  of  Contracting  Management.  These 
open-ended  questions  allowed  participants  to  candidly  respond 
to  questions  without  the  formal  structure  imposed  by  the 
multiple  choice  questions.  The  researchers  informally  ana¬ 
lyzed  the  open-ended  questions  to  ascertain  respondents' 
feelings  and  expressions  of  intensity  about  the  AFIT  CAM  pro¬ 
gram  (17:219).  Furthermore,  responses  to  the  open-ended 
questions  were  compared  to  the  results  found  in  answering 
Research  Question  Three. 

The  Measurement  Scale 

The  ability  to  quantify  the  responses  in  the  Percep¬ 
tions  section  of  both  survey  instruments  was  of  extreme 
importance  in  answering  the  proposed  research  questions  and 
supporting  qualitative  research  hypotheses.  The  measurement 
scale  used  in  both  survey  instruments  was  the  seven-point 
Likert  scale.  The  Likert  scale  consisted  of  the  following 
seven  possible  responses: 

a.  Strongly  Disagree 

b.  Disagree 

c.  Slightly  Disagree 

d.  Undecided/Don’t  Know 

e.  Slightly  Agree 

f.  Agree 

g.  Strongly  Agree 

This  Likert  scale  allowed  the  researchers  to  measure  the  par¬ 
ticipants'  level  of  agreement  to  each  of  the  questions  in  the 
Perceptions  section  of  both  survey  instruments  (10:16). 

The  selection  of  the  Likert  scale  was  primarily  due  to 
the  ease  of  construction  and  its  discriminating  ability  in 
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respondent-centered  research.  That  is,  by  using  the  Likert 
scale,  the  researchers  were  able  to  consider  how  responses 
differed  among  graduates  and  supervisors  (17:250).  Emory 
notes : 

a  two-point  scale,  three-point  scale,  or  scale  with 
more  points  is  a  subject  which  is  debated;  there  is 
little  conclusive  support  for  any  particular  scale- 
length.  The  agreement  is  that  more  points  on  a  scale 
provide  an  opportunity  for  greater  sensitivity  of 
measurement  [17:239]. 

As  a  result,  the  researchers  determined  that  a  seven-point 
scale  would  best  satisfy  the  needs  of  this  research  effort. 

The  use  of  the  Likert  scale  resulted  in  ordinal  level 
data  (17:250).  Ordinal  level  data  is  defined  as  data  which 
are  ranked  (least  to  most)  with  respect  to  a  measured  attri¬ 
bute,  but  the  distance  between  ranked  items  is  unknown  (43: 
38).  The  two  attributes  measured  in  this  research  were  use¬ 
fulness  and  applicability.  These  two  attributes  were  measured 
via  the  seven-point  Likert  scale  found  in  the  survey  instru¬ 
ments. 

Distribution 

The  AFIT  Personnel  System  Management  Division  (AFIT/ 
DPW)  provided  a  computer-generated  listing  of  those  active 
duty  Air  Force  officers  and  civilians  who  have  graduated  from 
the  AFIT  Contracting  and  Acquisition  Management  (CAM)  graduate 
program  since  its  inception,  subject  to  the  criteria  estab¬ 
lished  for  the  target  population  presented  earlier  in  this 
chapter.  Upon  receiving  this  computer- generated  listing,  the 
researchers  manually  cross-checked  with  graduate  records 


maintained  in  the  AFIT  Registrar's  Office  (AFIT/RR)  to  ensure 
t.  ' 1  the  computer  listing  corresponded  with  official  AFIT 
records . 

The  physical  distribution  of  the  survey  instruments 
consisted  of  two  phases.  The  first  phase  was  to  send  to  the 
AFIT  CAM  graduates  a  survey  package  containing  the  following 
items : 

1.  The  graduate  survey  instrument  with  a  self- 
addressed  return  envelope. 

2.  A  sealed  package  containing  the  supervisor  survey 
instrument  with  a  self-addressed  return  envelope. 

In  the  second  phase,  the  AFIT  CAM  graduates  were  instructed 
to  hand-carry  the  sealed  supervisor  package  to  his/her  rating 
official  (for  military)  or  performance  appraisal  official 
(for  civilians).  This  technique  was  utilized  by  the  Crowder/ 
Davidson  research  team  with  a  high  degree  of  success  (15:21, 
29)  . 

Data  Analysis  Plan 

As  previously  noted,  the  data  measurements  from  the 
Perceptions  section  of  each  survey  instrument  were  considered 
ordinal  level  data.  As  a  result,  the  statistical  analyses 
performed  were  nonparametric  statistical  tests.  Siegel  de¬ 
fines  a  nonparametric  test  as  "a  test  whose  model  does  not 
specify  conditions  about  the  parameters  of  the  population  from 
which  the  sample  was  drawn  [41:31]."  Furthermore,  Siegel 
categorically  states,  "Parametric  statistical  tests,  which  use 
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mean  and  standard  deviations  .  .  .  ought  not  to  be  used  with 
data  in  an  ordinal  scale  [41:26]."  Thus,  nonparametric  sta¬ 
tistical  analysis  of  the  Perceptions  section  data  was  justi¬ 
fied.  Analysis  of  the  data  in  the  Demographics  section  of  the 
graduate  survey  was  descriptive  in  nature.  The  technique 
utilized  to  analyze  the  demographic  data  consisted  of  a  series 
of  numerical  tables.  The  analysis  of  the  open-ended  questions 
in  the  last  section  of  the  survey  instruments  consisted  of  a 
qualitative  assessment  by  the  researchers  to  determine  if  a 
consensus  of  opinion  existed  among  the  respondents  concerning 
these  questions.  The  research  questions,  supporting  qualita¬ 
tive  research  hypotheses,  and  applicable  survey  instrument 
questions  that  comprise  this  study's  research  methodology  are 
restated  below: 

Research  Question  One:  What  are  the  perceptions  of 
active  duty  Air  Force  military  and  civilian  AFIT  CAM  graduates 
and  their  supervisors  regarding  the  usefulness  of  a  graduate 
AFIT  CAM  education  in  postgraduate  assignments? 

Supporting  Qualitative  Research  (Null)  Hypotheses  for 
Research  Question  One: 

1.  Active  duty  Air  Force  military  and  civilian  AFIT 
CAM  graduates  perceive  the  AFIT  CAM  program  as  not  useful  in 
postgraduate  assignments. 

2.  Supervisors  of  active  duty  Air  Force  military  and 
civilian  AFIT  CAM  graduates  perceive  the  AFIT  CAM  program  as 
not  useful  to  their  subordinates  in  postgraduate  assignments. 

3.  There  is  no  significant  difference  between  active 
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duty  Air  Force  military  and  civilian  AFIT  CAM  graduates'  and 
their  supervisors'  perceptions  of  AFIT  CAM  program  usefulness. 

4.  Active  duty  Air  Force  military  and  civilian  AFIT 
CAM  graduates'  perceptions  of  AFIT  CAM  program  usefulness  do 
not  change  over  time. 

Applicable  Survey  Instrument  Questions: 

Graduate  Survey  --  Questions  26-30,  62,  and  64-66 
Supervisor  Survey  --  Questions  5-9,  and  42 

Research  Question  Two:  What  is  the  demographic  profile 
of  active  duty  Air  Force  military  and  civilian  AFIT  CAM  gradu¬ 
ates? 

Supporting  Research  (Null)  Hypotheses  for  Research 
Question  Two:  Not  applicable. 

Applicable  Survey  Instrument  Questions: 

Graduate  Survey  --  Questions  1-25 
Supervisor  Survey  --  Not  applicable 

Research  Question  Three:  What  are  the  most/least  use¬ 
ful  subject  areas  in  the  AFIT  CAM  curriculum  as  perceived  by 
active  duty  Air  Force  military  and  civilian  graduates  and 
their  supervisors? 

Supporting  Qualitative  Research  (Null)  Hypotheses  for 
Research  Question  Three:  Not  applicable. 

Applicable  Survey  Instrument  Questions: 

Graduate  Survey  --  Questions  31-61,  63,  and  68 
Supervisor  Survey  --  Questions  10-41,  and  43 

Statistical  Methodology 

The  appropriate  measure  of  central  tendency  for  ordinal 
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scale  data  is  the  median  (17:115).  The  median  may  be  defined 
as  the  centermost  number  of  a  data  set  arranged  in  ascending 
(or  descending)  order  of  magnitude  such  that  half  of  the 
measurements  fall  below  the  median  and  half  fall  above  (32: 
43-44).  If  the  total  number  of  measurements  are  even,  the 
median  is  the  average  of  the  two  middle  measurements,  when 
the  measurements  are  in  ascending  (or  descending)  order  (32: 
44).  If  the  total  number  of  measurements  are  odd,  the  median 
is  the  middle  number  of  the  ascending  (or  descending)  arranged 
measurements  (32:44).  The  median,  as  described  above,  was 
utilized  throughout  this  research  project  to  evaluate  the  re¬ 
search  questions  and  hypotheses  posed  earlier. 

To  use  the  median,  the  seven-point  Likert  scale  used 
in  the  survey  instruments  was  converted  from  an  alpha  scale 
(i.e.,  a-g  inclusive)  to  an  arabic  numerical  scale  (i.e., 

1-7  inclusive).  The  purpose  of  this  transformation  was  to 
enable  the  researchers  to  calculate  numerical  medians.  The 
relationship  between  the  survey  instrument  alpha  scale  and 


its  numerical  equivalent  scale  is  as  follows: 

Alpha  Scale  Adj  ective  Numerical  Scale 

a  Strongly  Disagree  1 

b  Disagree  2 

c  Slightly  Disagree  3 

d  Undecided/Don't  Know  4 

e  Slightly  Agree  5 

f  Agree  6 

g  Strongly  Agree  7 
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For  example,  if  a  participant  answered  a  question  as  "d"  in 
the  survey  instrument,  that  answer  was  coded  as  a  "4"  by  the 
researchers  in  determining  a  median  response  to  that  question. 

The  general  technique  used  to  evaluate  (measure)  per¬ 
ceived  usefulness  of  the  AFIT  CAM  program  and  to  evaluate 
temporal  changes  in  perceived  usefulness  involved  a  respond¬ 
ent's  cumulative  score.  After  a  respondent's  answers  were 
converted  to  a  numerical  scale  for  each  of  the  survey  questions 
(i.e.,  Questions  26-30  and  62  for  graduates,  and  5-9  and  42 
for  supervisors),  the  respondent's  cumulative  score  was  the 
sum  of  the  individual  question  numerical  values.  Research 
Hypotheses  One  through  Four  were  evaluated  using  the  set  of 
all  respondents'  cumulative  scores. 

Before  conducting  any  of  the  nonparametric  tests  asso¬ 
ciated  with  Research  Hypotheses  One  through  Four  to  evaluate 
Research  Question  One,  the  pertinent  survey  instrument  ques¬ 
tions  were  further  validated  using  a  contingency  table 
analysis.  The  only  survey  questions  used  in  the  contingency 
table  analysis  were  Questions  26-30  and  62  for  graduates  and 
Questions  5-9  and  42  for  supervisors.  These  survey  questions, 
hereafter  called  usefulness  questions,  were  specifically  written 
to  measure  the  overall  usefulness  of  the  AFIT  CAM  graduate 
education.  Contingency  table  analysis  is  a  method  of  deter¬ 
mining  if  a  relationship  exists  in  multinomial  count  data 
classified  on  two  scales  (32:530).  In  this  research,  the 
purpose  of  the  contingency  table  analysis  was  to  ensure  that 
a  respondent's  cumulative  score,  as  defined  in  the  preceding 
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paragraph,  was  a  valid  measure  of  perceived  usefulness  of  the 
AFIT  CAM  program.  If,  on  some  of  the  usefulness  questions, 
the  percentage  of  respondents  who,  for  example,  agreed  to  a 
particular  question  differed  significantly  from  the  percent¬ 
age  who  agreed  on  the  remaining  questions,  then  that  question 
would  not  have  appeared  to  measure  perceived  usefulness  of 
the  AFIT  CAM  program.  This  is  shown  in  the  following  example: 


Question  Number 

%  Agree 

1  Undecided 

%  Disagree 

26 

65 

10 

25 

27 

65 

10 

25 

28 

25 

10 

65 

29 

65 

10 

25 

30 

25 

10 

65 

62 

65 

10 

25 

Clearly,  the  percentage  of  agreement  responses  to  Questions 
28  and  30  are  inconsistent  with  the  other  four  questions. 

If  this  situation  were  the  case,  then  a  respondent's  cumula¬ 
tive  score,  the  sum  of  individual  question  values,  would  be  a 
sum  of  values  that  appear  to  measure  perceived  usefulness  of 
the  program  as  well  as  values  that  do  not.  Therefore,  the 
total  cumulative  score  would  not  represent  a  valid  measure 
of  perceived  usefulness  of  the  AFIT  CAM  program.  The  contin¬ 
gency  table  analysis  used  in  this  research  protected  against 
this  undesirable  state.  If  inconsistency  in  the  usefulness 
questions  occurred,  then  the  question(s)  that  caused  the  in¬ 
consistency  would  be  eliminated  from  further  analysis. 

For  purposes  of  contingency  table  analysis  only,  the 
survey  instrument  response  scale  was  recoded  into  three 
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categories  (disagree,  undecided,  agree)  from  the  seven-point 
Likert  scale.  The  reason  for  this  recoding  was  to  avoid 
having  frequency  of  responses  less  than  five  for  any  given 
response  on  the  seven-point  Likert  scale.  If  all  seven  Likert 
scale  responses  had  been  used,  the  frequency  of  response  to 
any  of  the  seven  response  categories  would  have  been  smaller 
than  those  of  the  three  recoded  response  categories.  The 
researchers  believed  that  with  the  seven  response  categories, 
contingency  table  analysis  would  not  have  provided  the  neces¬ 
sary  measure  of  consistency  to  evaluate  the  remaining  statis¬ 
tical  hypotheses.  And  since  contingency  table  analysis 
employs  a  Chi-Square  statistic,  the  approximation  to  the  samp¬ 
ling  distribution  should  be  avoided  when  the  expected  numbers 
are  very  small  (i.e.,  less  than  five)  (32:538).  Therefore, 
responses  of  Strongly  Disagree,  Disagree,  or  Slightly  Disagree 
were  recoded  under  Disagree  in  the  contingency  table;  and 
Strongly  Agree,  Agree,  or  Slightly  Agree  were  recoded  under 
Agree  in  the  contingency  table.  A  response  of  Undecided/Don't 
Know  was  coded  directly  into  the  contingency  table. 

To  determine  if  the  undecided  responses  biased  the  re¬ 
sults  of  the  contingency  table  analysis,  the  statistical  test 
was  conducted  twice.  The  first  statistical  test  combined  the 
responses  of  "Disagree"  and  "Undecided"  and  compared  this  sum 
to  the  response  of  "Agree."  The  second  statistical  test  com¬ 
bined  the  responses  of  "Agree"  and  "Undecided"  and  compared 
this  sum  to  the  response  of  "Disagree."  The  researchers  be¬ 
lieved  that  as  a  result  of  these  combinations,  a  true  measure 


of  consistency  in  the  usefulness  questions  was  obtained. 

The  null  hypothesis  (Hq)  and  alternative  hypothesis 
(Ha)  for  the  contingency  table  analyses  were: 

H^:  The  answers  to  all  usefulness  questions  are  con¬ 
sistent  with  each  other,  in  that  the  expected 
percentage  responses  for  the  usefulness  questions 
are  the  same  (i.e.,  the  population  percentages 
of  agree,  neutral,  and  disagree  are  the  same  for 
each  question) . 

H^:  There  exists  inconsistency  in  the  percentage  res¬ 

ponses  of  at  least  two  of  the  usefulness  questions. 
The  alpha  level  (a)  in  this  analysis  was  .05.  This  alpha  level 
represents  a  .95  probability  of  making  the  correct  choice  with 
the  data,  or  a  .05  chance  of  a  Type  I  error  (i.e.,  rejecting 
Hq  when  HQ  is  true ) (32 : 222) . 

By  rejecting  HQ ,  the  researchers  would  have  concluded 
that  there  existed  inconsistency  in  the  percentage  responses 
of  at  least  two  of  the  usefulness  questions.  By  not  reject¬ 
ing  Hq ,  the  researchers  would  have  concluded  that  there  was 
insufficient  evidence  to  indicate  that  inconsistency  existed 
among  the  survey  questions.  In  the  event  that  the  research¬ 
ers  rejected  HQ,  the  questions  which  indicated  inconsistency 
were  eliminated  from  further  analysis  because  the  questions 
were  not  valid  measurements  of  perceived  usefulness  of  the 
AFIT  CAM  program.  Following  elimination,  the  contingency 
table  analysis  would  have  been  reaccomplished  with  the  remain¬ 
ing  consistent  questions.  Upon  determining  the  number  of 


consistent  usefulness  questions  (i.e.,  26*30  and  62  for  gradu¬ 
ates,  and  5-9  and  42  for  supervisors),  a  predetermined  neutral 
score  was  calculated  by  multiplying  the  number  of  consistent 
questions  by  four,  the  neutral  point  on  the  Likert  scale. 

For  example,  if  all  six  usefulness  questions  were  consistent, 
the  predetermined  neutral  score  was  twenty- four. 

Following  validation  of  the  usefulness  questions,  the 
four  qualitative  research  hypotheses  used  in  conjunction  with 
Research  Question  One  were  individually  evaluated.  The  sta¬ 
tistical  equivalent  Hq  and  for  Research  Hypothesis  One  was: 
Hq:  The  median  graduate  respondent's  cumulative  score 
<_  24  (i.e.,  the  predetermined  neutral  score) 

Ha:  The  median  graduate  respondent's  cumulative  score 
>  24 
a  =  .05 

By  rejecting  HQ,  the  researchers  would  have  concluded 
that  AFIT  CAM  graduates  perceived  the  program  as  useful.  By 
not  rejecting  HQ,  the  researchers  would  have  concluded  that 
there  was  insufficient  evidence  to  indicate  that  AFIT  CAM 
graduates  considered  the  AFIT  CAM  program  useful. 

The  statistical  equivalent  Hq  and  for  Research  Hypo¬ 
thesis  Two  was: 

Hq:  The  median  supervisor  respondent's  cumulative 

score  <_  24  (i.e.,  the  predetermined  neutral  score) 
H^:  The  median  supervisor  respondent's  cumulative 
score  >  24 
a  =  .05 
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By  rejecting  Hq ,  the  researchers  would  have  concluded 
that  the  supervisors  of  AFIT  CAM  graduates  perceived  the  pro¬ 
gram  as  useful.  By  not  rejecting  Hq  ,  the  researchers  would 
have  concluded  that  there  was  insufficient  evidence  to  indi¬ 
cate  that  supervisors  of  AFIT  CAM  graduates  considered  the 
AFIT  CAM  program  useful. 

The  statistical  test  utilized  for  Research  Hypotheses 
One  and  Two  is  an  extension  to  the  Wilcoxon  Signed  Rank  Test 
(12:211).  This  statistical  test  allowed  the  researchers  to 
compare  respondents'  scores  to  a  predetermined  neutral  score 
to  ascertain  whether  respondents  considered  the  AFIT  CAM  pro¬ 
gram  useful. 

The  statistical  equivalent  Hq  and  for  Research 
Hypothesis  Three  were: 

Hq:  The  median  graduate  respondent's  score  =  the 
median  supervisor's  score. 

Ha:  The  median  graduate  respondent's  score  f  the 
median  supervisor's  score. 

a  =  .05 

By  rejecting  Hq,  the  researchers  would  have  concluded 
that  there  was  a  difference  of  opinion  between  graduates  and 
supervisors  on  the  usefulness  of  the  AFIT  CAM  program.  By  not 
rejecting  Hq,  the  researchers  would  have  concluded  that  there 
was  insufficient  evidence  to  indicate  that  a  difference  of 
opinion  existed  between  graduates  and  supervisors  on  the  use¬ 
fulness  of  the  AFIT  CAM  program. 

The  statistical  test  utilized  for  Research  Hypothesis 


Three  was  the  Wilcoxon  Rank  Sum  Test  (32:494).  This  test 
allowed  the  researchers  to  compare  graduate  respondent  scores 
to  supervisor  respondent  scores  to  determine  if  a  difference 
of  opinion  existed. 

The  statistical  equivalent  and  for  Research 
Hypothesis  Four  were: 

H^:  Graduate  median  responses  of  AFIT  CAM  program 

usefulness  do  not  change  over  time  (no  correla¬ 
tion)  . 

Ha:  Graduate  median  responses  of  AFIT  CAM  program 

usefulness  do  change  over  time  (correlation) . 

a  =  .05 

By  rejecting  HQ ,  the  researchers  would  have  concluded 
that  graduate  perceptions  of  the  usefulness  of  the  AFIT  CAM 
program  either  declined  or  improved  over  time.  By  not  reject¬ 
ing  Hq,  the  researchers  would  have  concluded  that  there  was 
insufficient  evidence  to  indicate  that  graduate  perceptions 
of  usefulness  had  changed  over  time. 

The  statistical  test  utilized  for  Research  Hypothesis 
Four  was  the  Spearman  Nonparametric  Test  for  Rank  Correlation 
(32:513).  This  statistical  test  used  the  ranks  of  measurement 
to  determine  a  measure  of  correlation  (32:511).  In  this  re¬ 
search,  the  two  variables  tested  for  correlation  were  gradu¬ 
ate  respondent  cumulative  score  and  the  length  of  time  (years) 
since  graduating  from  the  AFIT  CAM  program.  Additionally, 
Questions  64-66  of  the  graduate  survey  directly  asked  gradu¬ 
ates  if  their  perceived  usefulness  of  the  AFIT  CAM  program  had 
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changed  over  time.  The  results  of  graduate  survey  Questions 
64-66  were  used  to  further  substantiate  the  results  of  the 
Spearman  Rank  Test  in  answering  Research  Hypothesis  Four. 

The  research  design  used  to  answer  Research  Question 
Two  involved  nineteen  numerical  tables  describing  AFIT  CAM 
graduates.  These  descriptive  tables  utilized  responses  to 
Questions  1-25  from  the  graduate  survey  instrument.  The  numer¬ 
ical  tables  enabled  the  researchers  to  establish  a  demographic 
profile  of  AFIT  CAM  graduate  respondents.  The  following  list¬ 
ing  identifies  the  graduate  survey  instrument  questions  and 
the  corresponding  numerical  table  developed  from  those  survey 
questions : 

Graduate  Survey 

Question  Number  Applicable  Numerical  Table 

2,3  AFIT  CAM  Graduate  Respondents  By  Age  Group 

(Table  4.3) 

3,6,7  AFIT  CAM  Graduate  Respondents  by  Graduation 

Rank/Grade  and  Present  Rank/Grade  (Table  4.4) 

11  Current  AFIT  CAM  Graduate  Respondent  Air 
Force  Specialty  Code  (AFSC)/Job  Series 
(Table  4.5) 

12  AFIT  CAM  Graduate  Respondents  by  Specific 
65XX  AFSC/Job  Series  (Table  4.6) 

19  Graduate  Respondent  Current  Job  Description 

(Table  4.8) 

16  Job  Tenure  of  Graduate  Respondents  Currently 

Holding  Contracting  Jobs  (Table  4.10) 

13  Number  of  People  Supervised  by  AFIT  CAM 
Graduates  Currently  Holding  Contracting 
Related  Jobs  (Table  4.11) 

4,5,9  Graduate  Respondent  Assignments  By  Major 

Command  or  Other  Designation  (by  Number) 

(Table  4.12) 
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Graduate  Survey 

Question  Number  Applicable  Numerical  Table 


4,5,9 

8 

21 

23 


23 


15 

17 

18 

20 

10 

22 


Graduate  Respondent  Assignments  by  Major  Command 
or  Other  Designation  (by  Percentage)  (Table 
4.13) 

Graduate  Respondent  Level  of  Assignment- 
(Table  4.15) 

Graduate  Contracting/Manufacturing  Experi¬ 
ence  Prior  to  Entering  the  AFIT  CAM  Program 
(Table  4.16) 

Respondents  With  Pre-AFIT  CAM  Contracting 
Experience:  Attendance  at  Lowry  AFB/ 

Ft.  Belvoir  (Table  4.17) 

Respondents  Without  Pre-AFIT  CAM  Contracting 
Experience:  Attendance  at  Lowry  AFB/ 

Ft.  Belvoir  (Table  4.18) 

Graduate  Respondent  Contracting/Non- 
Contracting  Assignments  Since  AFIT  CAM 
Graduation  (Table  4.19) 

Number  of  Graduate  Respondent  Contracting- 
Related  Assignments  Since  AFIT  CAM  Gradua¬ 
tion  (Table  4.20) 

Graduate  Respondent  Contracting/Manufacturing 
Experience  Levels  (Table  4.21) 

Graduate  Respondent  Assignments  By  Level  of 
Acquisition  (Table  4.22) 

Current  Graduate  Respondent  Educational 
Levels  (Table  4.23) 

AFIT  PCE  Courses  Attended  By  Graduate  Res¬ 
pondents  Following  AFIT  CAM  Program 
(Table  4.24) 


For  each  of  the  survey  questions  identified  above,  the 


researchers  summed  the  number  of  AFIT  CAM  respondents,  placing 


the  figures  in  the  respective  tables.  To  convert  numerical 


response  rates  into  percentages,  the  total  number  of  respond¬ 
ents  providing  a  given  answer  was  divided  by  the  total  number 
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of  research  participants.  These  percentages  were  also  placed 
in  the  respective  tables. 

There  were  four  survey  questions  (i.e.,  1,  14,  24  and 
25)  in  the  Demographic  section  of  the  graduate  survey  instru¬ 
ment  that  were  not  incorporated  into  numerical  tables.  Survey 
Question  1  was  used  to  narratively  describe  responses  by  sex. 
Survey  Question  14  was  used  in  narrative  description  of  AFIT 
CAM  graduate  respondents'  perceptions  of  their  supervisors' 
familiarity  with  the  graduates'  job.  Finally,  Survey  Ques¬ 
tions  24  and  25  were  used  in  a  narrative  description  of  AFIT 
CAM  graduate  respondents'  professional  development  activities 
since  graduation. 

The  research  design  used  to  answer  Research  Question 
Three  involved  determining  the  most/least  useful  subject  areas 
in  the  AFIT  CAM  curriculum  as  perceived  by  AFIT  CAM  graduate 
respondents  and  their  supervisors.  The  determination  of 
most/least  useful  subject  areas  in  the  graduate  AFIT  CAM  cur¬ 
riculum  involved  the  calculation  of  the  median  response  for 
each  survey  question  pertaining  to  the  curriculum.  For  AFIT 
CAM  graduates,  Questions  31-61,  63,  and  68  were  utilized. 

For  supervisors  of  AFIT  CAM  graduates.  Questions  10-41  and  43 
were  utilized  in  the  curriculum  evaluation.  After  the  median 
response  for  each  question  was  calculated,  the  responses  were 
ranked  from  highest  to  lowest  for  each  population.  Thus, 
rankings  of  sub ject  areas  in  terms  of  perceived  usefulness  were 
accomplished  for  both  AFIT  CAM  graduates  and  supervisors. 

After  the  two  rankings  were  completed,  the  researchers 
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subjectively  analyzed  the  results  to  determine  if  there  was 
significant  agreement  or  disagreement  between  the  AFIT  CAM 
graduates  and  their  supervisors  concerning  the  AFIT  CAM  cur¬ 
riculum. 


Assumptions  and  Limitations 

The  researchers  made  several  assumptions  in  this  re¬ 
search  project.  These  assumptions  were  divided  into  two 
categories:  statistical  assumptions  and  general  assumptions. 

Both  categories  of  assumptions  were  critical  to  the  consistency 
of  the  research  and  are  identified  below. 

Statistical  Assumptions 

1.  The  use  of  a  seven-point  Likert  scale  in  the  ques¬ 
tionnaire  resulted  in  ordinal  level  data. 

2.  The  population  distributions  from  which  the  samples 
were  drawn  were  unknown.  As  a  result,  the  use  of  nonparamet- 
ric  statistics  was  justified. 

3.  Statistical  analysis  of  ordinal  data  was  properly 
handled  with  nonparametric  techniques. 

4.  The  purposive  sampling  technique  was  a  valid  means 
of  developing  a  sample  for  nonparametric  testing. 

General  Assumptions 

1.  The  research  respondents  provided  honest  responses 
and  took  a  reasonable  amount  of  time  to  consider  each  response 


to  questions  on  the  survey  instrument  (15:27). 

2.  The  survey  instruments  were  reliable  attitude 


measurement  tools  that  were  adequately  validated. 

3.  The  researchers'  definition  of  usefulness  was 
appropriate  for  this  research  study. 

There  were  also  several  limitations  identified  for 
this  research  study.  These  limitations  are  identified  below. 

Limitations 

1.  The  conclusions  of  this  research  study  apply  only 
to  the  two  samples  of  respondents  identified  earlier  in  this 
chapter. 

2.  Measurement  of  perceptions  and  attitudes  was  quali¬ 
tative  in  nature. 

3.  Responses  to  the  open-ended  questions  were  inter¬ 
preted  and  analyzed  by  the  researchers  and  conclusions  were 
based  on  the  researchers'  subjective  judgment  (15:28). 

Summary 

Chapter  1  described  the  need  for  contracting  education, 
defined  the  research  problem,  and  presented  Research  Questions 
and  supporting  Research  Hypotheses.  Chapter  2  provided  back¬ 
ground  and  discussed  the  origins  of  Government  procurement 
education,  the  availability  of  procurement  education  today, 
and  the  development  of  the  AFIT  CAM  program  from  its  inception 
to  the  present  day.  This  chapter  described  the  procedures 
used  by  the  researchers  to  evaluate  the  usefulness  of  the 
graduate  AFIT  CAM  program.  These  research  procedures  included 
a  contingency  table  analysis,  nonparametric  statistical  analy¬ 
sis,  descriptive  numerical  tables,  and  the  rank  ordering  of 
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most/least  useful  subject  areas  in  the  AFIT  CAM  program  curri¬ 
culum.  Using  the  research  methodology  outlined  in  this 
chapter,  the  researchers  proceeded  to  analyze  the  data  in 
Chapter  4. 


CHAPTER  4 


DATA  ANALYSIS 

Introduction 

The  purpose  of  the  Data  Analysis  chapter  is  to  present 
and  analyze  survey  data  utilizing  the  research  methodology 
formulated  in  Chapter  3.  Included  in  this  chapter  are:  1) 
a  survey  response  summary;  2)  a  contingency  table  analysis  to 
validate  the  usefulness  questions;  and  3)  analysis  of  all 
three  research  questions  stated  in  Chapter  1.  Analysis  of 
the  research  questions  consisted  of  nonparametric  statistical 
tests,  a  demographic  profile  of  graduate  respondents,  and  a 
rank  ordering  of  AFIT  CAM  curriculum  courses.  Finally,  this 
chapter  analyzed  the  open-ended  survey  questions  concerning 
incorporation  of  Professional  Continuing  Education  (PCE) 
courses  in  the  AFIT  CAN*,  curriculum. 

Survey  Response  Summary 

The  response  rates  for  graduate  and  supervisor  ques¬ 
tionnaires  (see  Appendices  A  and  B)  compared  favorably  to 
those  achieved  by  Crowder  and  Davidson  (15:29),  originators 
of  the  survey  approach  used  in  this  research  effort.  A  total 
of  105  graduate  survey  questionnaires  were  mailed,  102  male 
and  3  female;  77  graduates  responded  (73.3  percent),  75  male 
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and  2  female.  A  total  of  78  supervisor  questionnaires 
were  mailed;  41  supervisors  responded  (52.6  percent).  Table 
4.1  summarizes  the  survey  response  rate  percentages  by  class 
year. 

TABLE  4.1 


Response  Percentage  by  Class  Year 


Class 

Year 

Total 

Response 

%  Total 
Response 

Target 

Class 

Population 

%  Response 
Within 

Each  Class 

8 

10.4 

n 

72.7 

9 

11.1 

11 

81.8 

1979B 

8 

10.4 

10 

80.0 

1979A 

7 

9.1 

8 

87.5 

1978B 

6 

7.8 

7 

85.7 

1978A 

5 

6.5 

7 

71.4 

1977B 

5 

6.5 

7 

71.4 

1977A 

3 

3.9 

7 

42.8 

1976B 

5 

6.5 

8 

62.5 

1976A 

5 

6 . 5 

7 

71.4 

1975B 

7 

9.1 

9 

77.7 

1975A 

3 

3.9 

4 

75.0 

1974B 

6 

7.8 

9 

66.6 

Total 

77 

100.0 

105 

N/A 

Crowder  and  Davidson  achieved  a  72.3  percent  and  62.5  percent 
response  rate  for  graduates  and  supervisors,  respectively 
(15:29) . 

The  response  rate  within  each  class  for  ten  of  the 
thirteen  AFIT  CAM  respondent  classes  was  greater  than  70  per¬ 
cent  (see  Table  4.1).  The  percentage  response  rate  within 
AFIT  CAM  respondent  class  1979A  was  the  highest,  at  87.5 
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percent;  AFIT  CAM  respondent  class  1977A  was  lowest  at  42.8 
percent . 

Parts  I  and  II  of  all  survey  questionnaires  (i.e.,  the 
Demographics  and  Perceptions  sections)  were  completed  by  all 
respondents  in  their  entirety.  However,  Part  III  of  the  sur¬ 
vey  instruments,  Open-Ended  Questions,  received  less  than  a 
100  percent  completion  rate.  AFIT  CAM  graduate  completion 
rate  for  Part  III  of  the  questionnaire  was  92.2  percent  (71 
of  77  questionnaires);  supervisor  completion  rate  for  Part  III 
of  the  questionnaire  was  78.1  percent  (32  of  41  questionnaires). 

A  particularly  important  aspect  of  supervisor  responses 
was  to  ensure  that  supervisors  were,  in  fact,  familiar  with 
subordinate  job  requirements  and  duties.  Thus,  supervisor 
respondents  answering  "No"  to  Question  2  of  Part  I  in  the 
supervisor  questionnaire  were  of  no  use  in  the  research  and 
were  eliminated  from  the  study  if  encountered.  All  supervisor 
respondents,  however,  answered  that  they  were  familiar  with 
subordinate  job  requirements  and  performance.  As  a  result, 
no  supervisor  questionnaires  were  discarded  due  to  supervisor 
lack  of  knowledge  regarding  subordinate  job  requirements. 

Contingency  Table  Analysis 

Two  sets  of  contingency  tables  were  utilized  to:  1) 
ensure  that  respondent  scores  provided  a  valid  measure  of  per¬ 
ceived  usefulness  of  the  AFIT  CAM  program;  and  2)  assess  con¬ 
sistency  among  graduate  and  supervisor  responses  to  the  AFIT 
CAM  program  usefulness  questions.  The  first  set  of  contingency 
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tables,  illustrated  in  Appendix  C,  Tables  C-l  and  C-2,  show 
the  results  of  graduate  response  to  survey  Questions  26-30 
and  62,  the  AFIT  CAM  usefulness  questions.  Table  C-l  com¬ 
pares  graduates  who  did  not  agree  (column  1  responses)  with 
those  graduates  who  agreed  (column  2  responses)  that  the  AFIT 
CAM  program  was  useful.  That  is,  column  1  (Table  C-l)  res¬ 
ponses  included  graduates  answering  either  "Disagree"  or 
"Undecided"  to  graduate  survey  Questions  26-30  and  62.  Column 
2  (Table  C-l)  responses  included  only  those  graduates  answer¬ 
ing  "Agree"  to  these  same  questions. 

The  null  and  alternate  hypotheses  tested  were: 

Hq :  The  answers  to  all  usefulness  questions  are  con¬ 
sistent  (homogeneous)  with  each  other  in  that  the 
percentage  responses  for  all  of  the  usefulness 
questions  are  the  same. 

Ha:  There  exists  inconsistency  (non-homogeneity)  in 
the  percentage  responses  for  at  least  two  of  the 
usefulness  questions. 

7 

The  test  statistic  was  the  Chi-Square  table  value  for  X  qs  5 
or  11.0705.  The  decision  rule  was  to  reject  Hq  if  the  calcu¬ 
lated  Chi-Square  value  was  greater  than  11.0705.  The 
Appendix  C,  Table  C-l,  calculated  Chi-Square  value  was 
10.12207.  Therefore,  the  researchers  could  not  reject  the 
null  hypothesis  at  the  95  percent  confidence  level.  The  re¬ 
searchers  concluded  that  there  was  insufficient  evidence  to 
support  non-homogeneity  of  graduate  responses  to  the  battery 
of  questions  measuring  AFIT  CAM  program  usefulness. 


68 


Table  C-2  (Appendix  C)  compares  graduates  who  disagreed 
(column  1  responses)  with  those  graduates  that  either  agreed 
or  were  undecided  (column  2  responses)  regarding  the  AFIT  CAM 
program  usefulness.  Column  1  (Table  C-2)  responses  included 
only  those  graduates  answering  "Disagree"  to  graduate  survey 
Questions  26-30  and  62.  Column  2  (Table  C-2)  responses  in¬ 
cluded  graduates  answering  either  "Agree"  or  "Undecided"  to 
these  same  questions. 

The  null  and  alternate  hypotheses,  test  statistic,  and 
decision  rule  for  evaluating  Table  C-2  data  remained  the  same 
as  those  used  for  evaluating  Table  C-l  data.  The  Table  C-2 
calculated  Chi-Square  statistic  was  9.71171,  less  than  the 
test  statistic,  11.0705.  Therefore,  the  researchers  again 
could  not  reject  the  null  hypothesis  at  the  95  percent  confi¬ 
dence  level.  The  researchers  concluded  that  there  was  in¬ 
sufficient  evidence  to  support  non-homogeneity  of  responses 
by  graduates  to  the  battery  of  questions  measuring  AFIT  CAM 
program  usefulness.  The  conclusion  was  the  same  whether 
"Undecided"  graduate  respondents  were  grouped  with  those  gra¬ 
duates  who  "Agreed”  or  "Disagreed"  that  the  AFIT  CAM  program 
was  useful.  In  either  case,  there  was  insufficient  evidence 
to  reject  the  null  hypothesis. 

The  second  set  of  contingency  tables,  illustrated  in 
Appendix  C,  Tables  C-3  and  C-4,  assessed  consistency  among 
supervisor  responses  to  the  AFIT  CAM  program  usefulness  ques¬ 
tions.  Table  C-3  compares  supervisors  of  active  duty  military 
and  civilian  CAM  graduates  who  agreed (column  1  response)  with 
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those  that  either  disagreed  or  were  undecided  (column  2  res¬ 
ponses)  as  to  whether  the  AFIT  CAM  program  is  useful.  Column 
1  responses  included  only  those  supervisors  answering  "Agree" 
to  supervisor  survey  Questions  5-9  and  42,  the  AFIT  CAM  use¬ 
fulness  questions.  Column  2  responses  included  supervisors 
who  answered  "Disagree"  or  "Undecided"  to  these  same  questions. 

The  null  and  alternate  hypotheses,  test  statistic,  and 
decision  rule  for  evaluating  the  Table  C-3  and  C-4  data  re¬ 
mained  the  same  as  those  used  for  evaluating  Table  C-l  data. 

The  Table  C-3  calculated  Chi-Square  statistic  was  1.74159, 
less  than  the  test  statistic,  11.0705.  Therefore,  the  re¬ 
searchers  could  not  reject  the  null  hypothesis  at  the  95  per¬ 
cent  level.  The  researchers  concluded  there  was  insufficient 
evidence  to  support  non- homogeneity  of  supervisor  responses  to 
the  battery  of  questions  measuring  AFIT  CAM  program  usefulness. 

Appendix  C,  Table  C-4,  compares  supervisors  who  dis- 
agreed(column  1  responses)  as  to  whether  the  AFIT  CAM  program 
is  useful.  Column  1  (Table  C-4)  responses  included  only  those 
supervisors  answering  "Disagree"  to  supervisor  survey  Questions 
5-9  and  42.  Column  2  (Table  C-4)  responses  included  those 
supervisors  answering  either  "Agree"  or  "Undecided"  to  these 
same  questions. 

The  null  and  alternate  hypotheses,  test  statistic,  and 
decision  rule  used  to  evaluate  Table  C-4  data  remained  the 
same  as  those  used  for  evaluating  Table  C-l  data.  The  Table 
C-4  calculated  Chi-Square  statistic  was  2.03306,  less  than 
the  test  statistic,  11.0705.  The  researchers  again  could  not 
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reject  the  null  hypothesis  at  the  95  percent  confidence  level. 
The  researchers  concluded  there  was  insufficient  evidence  to 
support  non-homogeneity  of  responses  by  supervisors  to  the 
battery  of  survey  questions  measuring  AFIT  CAM  program  useful¬ 
ness.  In  both  Tables  C-3  and  C-4,  the  conclusion  was  the 
same  whether  "Undecided"  supervisor  respondents  were  grouped 
with  those  who  "Agreed"  or  "Disagreed"  that  the  AFIT  CAM  pro¬ 
gram  was  useful  to  graduates.  In  both  cases,  there  was 
insufficient  evidence  to  reject  the  null  hypothesis.  Overall, 
the  responses  to  questions  used  in  both  graduate  and  super¬ 
visor  questionnaires  to  measure  AFIT  CAM  program  usefulness 
were  assumed  to  be  statistically  consistent  measurements  of 
the  program's  usefulness.  There  was  insufficient  evidence 
to  conclude  otherwise. 

Perceptions 

Research  Question  One 

What  are  the  perceptions  of  active  duty  Air  Force 
military  and  civilian  AFIT  CAM  graduates  and  their  supervisors 
regarding  the  usefulness  of  a  graduate  AFIT  CAM  education  in 
postgraduate  assignments?  Four  ’•esearch  (null)  hypotheses 
were  used  to  answer  Research  Question  One: 

A.  Research  (Null)  Hypothesis  One:  Active  duty  Air  Force 
military  and  civilian  AFIT  CAM  graduates  perceive  the 
AFIT  CAM  program  as  not  useful  in  postgraduate  assignments 
1.  Statistical  Test:  Wilcoxon  Signed-Ranks  Test,  a  *  .05 


The  statistically  equivalent  Hq  and  for  Research 
Hypothesis  One  are: 

H»:  The  median  graduate  respondent's  cumulative 
score  <_  24. 

H.:  The  median  graduate  respondent's  cumulative 
score  >  24. 

Since  this  was  a  one-tailed  statistical  test,  the 
decision  rule  was  to  reject  Hq  if  one-half  the  calcu¬ 
lated  statistic  (the  two-tail  probability)  was  less 
than  the  statistical  level  of  significance  chosen, 
a  =  .05.  The  Hq  is  not  true  if  the  calculated  statis¬ 
tic  (z-score)  has  a  probability  of  occurring  less  than 
the  specified  alpha  (a)  level  (33:268). 

2.  Results :  Appendix  C,  Table  C-5,  illustrates  the  re¬ 
sults  of  the  Wilcoxon  Signed-Ranks  test  for  graduates. 
One-half  the  calculated  two-tail  probability  was  0.00, 
less  than  the  statistical  level  of  significance  cho¬ 
sen,  a  =  .05.  Therefore,  the  researchers  rejected 
the  Hq  and  were  95  percent  confident  that  graduates 
found  the  AFIT  CAM  program  useful. 

B.  Research  (Null)  Hypothesis  Two:  Supervisors  of  active 

duty  Air  Force  military  and  civilian  AFIT  CAM  graduates  per¬ 
ceive  the  AFIT  CAM  program  as  not  useful  to  their  subor¬ 
dinates  in  postgraduate  assignments. 

✓"I.  Statistical  Test:  Wilcoxon  Signed-Ranks  Test,  a  =  .05. 
The  statistically  equivalent  Hq  and  H^  for  Research 
Hypothesis  Two  were: 

Hq:  The  median  supervisor  respondent's  cumulative 
score  is  <_  24. 
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H.:  The  median  supervisor  respondent's  cumulative 
score  >  24. 

Since  this  was  a  one-tailed  test,  the  decision  rule 
was  to  reject  Hq  if  one-half  the  calculated  statistic 
(the  two- tail  probability)  was  less  than  the  statis¬ 
tical  level  of  significance  chosen,  a  =  .05. 

2.  Results :  Appendix  C,  Table  C-6,  illustrates  the 

results  of  the  Wilcoxon  Signed-Ranks  Test  for  super¬ 
visors.  One-half  of  the  calculated  statistic  (the 
two-tail  probability)  was  0.000,  less  than  the  statis¬ 
tical  level  of  significance  chosen.  Therefore,  the 
researchers  rejected  the  and  were  95  percent  con¬ 
fident  that  supervisors  of  active  duty  Air  Force 
military  and  civilian  CAM  graduates  consider  the  4FIT 
CAM  program  useful. 

C.  Research  (Null)  Hypothesis  Three:  There  is  no  significant 
difference  between  active  duty  Air  Force  military  and 
civilian  AFIT  CAM  graduates’  and  their  supervisors'  per¬ 
ceptions  of  AFIT  CAM  program  usefulness. 

1.  Statistical  Test:  Wilcoxon  Rank  Sum  Test,  a  =  .05. 

The  statistical  equivalent  Hq  and  HA  for  Research 
Hypothesis  Three  were: 

Hq :  The  median  graduate  respondent's  score  equals 
the  median  supervisor's  score. 

Ha:  The  median  graduate  respondent's  score  does  not 
equal  the  median  supervisor's  score. 

Since  this  was  a  two-tailed  test,  the  decision  rule 

was  to  reject  Hq  if  the  calculated  statistic  (two- 
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tailed  probability)  was  less  than  the  level  of  signi¬ 
ficance  chosen,  a  =  .05. 

2.  Results :  Appendix  C,  Table  C-7,  illustrates  the  re¬ 
sults  of  the  Wilcoxon  Rank  Sum  Test  for  graduates  and 
supervisors.  The  calculated  two-tailed  probability 
was  .6116,  greater  than  the  level  of  statistical  sig¬ 
nificance  chosen,  a  =  .05.  Therefore,  the  researchers 
could  not  reject  the  null  hypothesis.  There  was  in¬ 
sufficient  evidence  to  conclude  that  a  significant 
difference  in  perceptions  exists  between  graduates 
and  supervisors  concerning  usefulness  of  the  AFIT  CAM 
program. 

Research  (Null)  Hypothesis  Four:  Active  duty  Air  Force 
military  and  civilian  graduates'  perceptions  of  AFIT  CAM 
program  usefulness  do  not  change  over  time. 

1.  Statistical  Test:  Spearman's  Nonparametric  Test  for 
Rank  Correlation,  a  =  .05.  This  test  was  conducted 
to  determine  if  correlation  existed  between  a  gradu¬ 
ate's  cumulative  score  and  length  of  time  since  gradu¬ 
ation.  The  statistically  equivalent  HQ  and  HA  for 
Research  Hypothesis  Four  were: 

:  Graduate  median  responses  of  AFIT  CAM  program 
usefulness  do  not  change  over  time  (no  corre¬ 
lation)  . 

H^:  Graduate  median  responses  of  AFIT  CAM  program 
usefulness  do  change  over  time  (correlation). 

The  decision  rule  was  to  reject  HQ  if  the  calculated 

test  statistic  (the  significance  of  a)  was  less  than 
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the  standard  chosen,  a  =  .05. 

Results :  Appendix  C,  Table  C-8,  illustrates  the  re¬ 
sults  of  the  Spearman  Nonparametric  Test  for  Rank 
Correlation  for  graduates.  The  calculated  signifi¬ 
cance  was  .362,  greater  than  the  statistical  standard 
chosen,  a  =  .05.  Therefore,  the  researchers  could  not 
reject  the  H^.  There  was  insufficient  evidence  to  re¬ 
ject  the  notion  that  active  duty  Air  Force  military 
and  civilian  graduates’  perceptions  of  AFIT  CAM  pro¬ 
gram  usefulness  did  not  change  over  time. 

Graduate  survey  Questions  64,  65,  and  66  were  also 
used  as  a  more  informal,  or  non-statistical  means  to 
answer  Research  Hypothesis  Four.  In  analyzing  Ques¬ 
tion  64,  the  researchers  found  that  six  of  thirteen 
graduate  CAM  classes  mildly  disagreed  as  to  whether 
the  AFIT  CAM  program  was  of  more  value  in  current 
assignments  than  it  would  be  in  future  assignments. 

The  median  response  was  three,  or  "Slightly  Disagree." 
The  remaining  seven  classes  responded  with  a  median 
score  of  four,  or  "Undecided."  The  combined  median 
response  by  all  graduate  respondents  to  Question  64 
was  also  four,  or  "Undecided.” 

Question  65  asked  graduates  whether  their  AFIT  CAM 
education  would  be  of  more  value  in  future  assignments 
than  current  assignments.  Eight  of  the  thirteen 
classes  responded  with  a  median  score  of  four,  or 
"Undecided."  One  class  responded  '  ith  a  score  of  three, 
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or  "Slightly  Disagree."  Finally,  four  classes  indi¬ 
cated  agreement  with  a  median  response  of  five  and 
one-half,  between  "Slightly  Agree"  and  "Agree."  The 
combined  median  response  of  all  graduate  AFIT  CAM 
classes  to  Question  65  was  four,  or  "Undecided." 

In  responding  to  Question  66,  graduate  respond¬ 
ents  indicated  whether  or  not  their  AFIT  CAM  educa¬ 
tion  would  increase  in  value  over  time.  One  class 
perceived  that  no  increase  in  value  would  occur, 
responding  with  a  median  response  of  three  and  one- 
half,  between  "Slightly  Disagree"  and  "Undecided." 

Four  classes  responded  with  a  median  response  of  four, 
"Undecided."  Finally,  the  remaining  eight  classes 
believed  that  the  value  of  their  AFIT  CAM  education 
would  increase  over  time  with  a  median  response  of 
five,  or  "Slightly  Agree."  The  combined  median  res¬ 
ponse  from  all  graduate  classes  to  Question  66  was 
five,  or  "Slightly  Agree." 

A  summary  of  all  median  responses  to  Questions 
64,  65  and  66  is  provided  in  Table  4.2.  As  evidenced 
in  this  table,  no  obvious  trend  was  detected  in  the 
responses  to  indicate  a  change  in  graduate  perceptions 
of  AFIT  CAM  program  usefulness  over  time.  There  were 
no  significant  increases  or  de  reases  in  the  graduate 
respondent  answers  to  Questions  64,  65  and  66  to  sug¬ 
gest  a  trend  over  time.  This  conclusion,  however, 
further  supports  the  statistical  conclusion  reached 
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in  answering  Research  Hypothesis  Four.  That  is,  there 
is  insufficient  evidence  to  reject  the  null  hypothesis 
that  graduate  perceptions  of  AFIT  CAM  program  useful¬ 
ness  do  not  change  over  time. 


TABLE  4.2 


Median  Response  by  Class  Year 
to  Questions  64,  65,  and  66 


Class 

Median 

Response  to 

Question : 

64 

65 

66 

74B 

3.5 

4 

5.5 

7  5A 

4 

4 

5 

75B 

4 

4 

5 

76A 

3 

5 

5 

76B 

4 

4 

6 

Ilk 

4 

3 

4 

77B 

3 

4 

5 

78A 

3 

5 

6 

78B 

4 

4 

4 

79A 

3 

6 

4 

79B 

4 

4 

3.5 

80 

4 

4 

5 

81 

2 

6 

4 

Overall  Score  4 

4 

5 

Demographics 

Research  Question  Two 

What  is  the  demographic  profile  of  active  duty  Air 
Force  military  and  civilian  AFIT  CAM  graduates? 


The  following  tables  and  charts  describe  the  charac¬ 
teristics  of  the  two  survey  respondent  groups,  the  AFIT  CAM 


graduates  and  their  supervisors.  Inferences  concerning  the 
entire  population  of  active  duty  Air  Force  military  and  civil¬ 
ian  graduates  of  the  AFIT  CAM  program  are  neither  implied  nor 
attempted.  Any  attempt  to  do  so  would  be  invalid  as  the  actual 
demographic  composition  of  nonrespondents,  as  well  as  those 
purposely  excluded,  was  not  known  nor  available. 

Table  4.3  illustrates  military  and  civilian  AFIT  CAM 
graduate  respondents  by  age  group.  A  majority  (67.5  percent) 
of  AFIT  CAM  graduate  respondents  are  in  the  31-40  year  age 
group.  A  plurality  (36.5  percent)  of  graduate  respondents, 
however,  are  in  the  36-40  year  age  group. 


TABLE  4.3 

AFIT  CAM  Graduate  Respondents  By  Age  Group 


Age 

Military 

% 

Civilian 

% 

20-25 

0 

0 

0 

0 

26-30 

16 

21.6 

0 

0 

31-35 

23 

31.1 

2 

66.7 

36-40 

27 

36.5 

0 

0 

41-45 

8 

10.  8 

0 

0 

46-50 

0 

0 

1 

33.3 

Over  50 

0 

0 

0 

0 

Total 

74 

100.0 

3 

100.0 

Table  4.4  lists  active  duty  Air  Force  military  and 
civilian  AFIT  CAM  graduate  respondents  by  rank/grade  both  at 
graduation  and  as  of  the  date  of  the  research  surveys,  July 


1982.  A  majority  (81.8  percent)  of  AFIT  CAM  graduate  military 
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TABLE  4.4 


AFIT  CAM  Graduate  Respondents  by  Graduation  Rank/Grade 

and  Present  Rank/Grade 


respondents  were  Air  Force  captains  (0-3)  at  graduation  (see 
Table  4.4).  A  plurality  (44.2  percent)  of  graduate  military 
respondents  currently  remain  at  the  rank  of  Air  Force  captain 
(0-3).  A  majority  (66.7  percent)  of  civilian  AFIT  CAM  res¬ 
pondents  were  in  the  GS-12  grade  at  graduation.  All  civilian 
graduate  respondents  are  currently  at  the  rank  of  GS-12. 

Tables  describing  the  current  Air  Force  Specialty  Code 
(AFSC)  of  military  respondents  and  Job  Series  for  civilian 
respondents  were  inconclusive  due  to  military  graduates  ap¬ 
parently  misinterpreting  Questions  11  and  12  of  the  Demographic 

79 


i 


section  in  the  graduate  questionnaire.  In  Question  11,  gradu 
ates  were  asked  to  categorize  their  present  AFSC/Job  Series 
which  included  the  65XX  (military)  and  1100/1200  (civilian) 
contracting  related  career  fields.  Question  12  was  designed 
to  discriminate  among  the  different  65XX  or  1100/1200  career 
designations.  In  Question  11,  53  of  74  military  respondents 
categorized  their  current  AFSC  as  65XX,  while  all  3  civilian 
respondents  categorized  their  current  Job  Series  as  1100/1200 
In  Question  12,  however,  6C  military  respondents  circled 
specific  categories  with  65XX  specialties.  The  researchers 
concluded  that  seven  military  respondents  answered  Question 
12  inconsistently  with  Question  11.  Tables  4.5  and  4.6  illus 
trate  graduate  respondent  answers  when  asked  current  military 
AFSC/civilian  Job  Series  and  specific  65XX/1100/1200  special¬ 
ty,  if  assigned  in  the  contracting  field,  respectively. 

TABLE  4.5 


Current  AFIT  CAM  Graduate  Respondent  AFSC/Job  Series 


AFSC/Job  Series 

Number 

65XX 

53 

68.8 

2  7  XX 

3 

3.9 

66XX 

1 

1.3 

Civilian  (1100/1200) 

3 

3.9 

Other 

17 

22.1 

Total 

77 

ioo.  0 

A  recount  of  questionnaires  verified  the  previous 
reasoning.  Table  4.7  lists  the  answers  given  for  Questions 
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TABLE  4.6 


AFIT 

CAM  Graduate  Respondents  by 
6 5 XX  AFSC/Job  Series 

Specific 

AFSC/Job 

Series 

Number 

% 

6S34 

19 

24.  7 

6531 

3 

3.9 

6524 

5 

6.5 

6521 

1 

1.3 

6516 

20 

26.0 

6511 

10 

13.0 

6596 

2 

2.6 

Civilian 

(1100/1200) 

3 

3.9 

N/A 

14 

18.2 

Total 

77 

100.0 

11  and  12  by  class  year  for  the  seven  military  respondents 
who  misinterpreted  these  two  questions. 


TABLE  4.7 

Seven  Inconsistent  Graduate  Responses  to 
Questions  11  and  12 


Class 

Question  11 

Question  12 

81 

2  7XX 

6534 

78A 

Other 

6534 

77B 

Other 

6516 

76A 

Other 

6516 

76A 

Other 

6534 

75A 

Other 

6524 

74B 

27XX 

6516 

The  researchers  interpreted  these  seven  inconsistent  responses 
to  mean  that  the  seven  individuals,  all  military,  are  currently 


assigned  to  positions  not  characterized  by  a  65XX  AFSC;  how¬ 
ever,  the  researchers  concluded  that  the  seven  graduates 
still  maintain  a  65XX  AFSC  in  their  official  military  person¬ 
nel  records.  Therefore,  the  researchers  considered  Question 
11  graduate  survey  responses  in  Table  4,5  to  be  accurate. 
Table  4.7  resolves  the  discrepancy  between  Tables  4.5  and  4.6 
A  majority  (72.7  percent)  of  AFIT  CAM  graduate  respond 
ents  are  currently  assigned  in  the  Contracting/Manufacturing 
career  field  (i.e.,  65XX  AFSC  or  1100/1200  series  career 
designations  for  civilians) (see  Table  4.5).  A  plurality 
(28.6  percent)  of  graduate  respondents  identified  themselves 
as  either  Principal  Contracting  Officers  or  Contracting  Staff 
(see  Tables  4.8  and  4.9).  These  two  categories  of  graduates 
were  closely  followed  by  graduate  respondents  classifying 
their  job  in  either  Systems  Contract  Administration  (12.9  per 
cent)  or  Rated  (12.9  percent)  duties. 


TABLE  4.8 

Graduate  Respondent  Current  Job  Description 


Job  Description 

Number 

% 

Contract  Negotiator 

7 

9.1 

Contract  Specialist 

1 

1.3 

Principal  Contracting  Officer 

11 

14.3 

Administrative  Contracting  Officer 

4 

5.2 

Manufacturing/Production 

6 

7.8 

Other 

48 

62.3 

Total 

77 

100.0 

In  Table  4.9,  the  researchers  classified  graduate  res¬ 
pondent  job  descriptions  within  the  Table  4.8  "Other" 
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category  into  seven  broad  areas. 


TABLE  4.9 

Graduate  Respondent  Job  Descriptions 
Within  "Other"  Category 


Job 

Number 

% 

Contracting  Staff 

11 

14.3 

Systems  Contract  Buyer 

4 

5.2 

Systems  Contract  Administration 

10 

12.9 

Base  Contracting 

3 

4.0 

Production/Manuf acturing/QA 

4 

5.2 

Rated 

10 

12.9 

Air  University 

6 

7.8 

Total 

48 

62.3 

Sixty-one  AFIT  CAM  graduate  respondents  currently  hold 
contracting/manufacturing  assignments.  This  number  includes 
graduate  respondents  found  in  the  first  five  categories  of 
both  Tables  4.8  (29  graduate  respondents)  and  4.9  (32  gradu¬ 
ate  respondents) .  Sixteen  graduate  respondents  are  currently 
assigned  to  either  Rated  (10  graduate  respondents)  or  Air 
University  (6  graduate  respondents)  duties  (see  Table  4.9). 
Among  the  61  AFIT  CAM  graduate  respondents  currently  holding 
contracting/manufacturing  assignments,  a  majority  (50.8  per¬ 
cent)  have  held  their  job  for  one  year  or  less  (see  Table 
4.10).  Seventy-eight  percent  of  AFIT  CAM  graduate  respond¬ 
ents  have  held  their  present  contracting/manufacturing  job 
less  than  two  years.  Table  4.10  displays  how  long  the  61 
graduate  respondents  currently  holding  contracting  jobs  have 


held  their  present  job. 

Table  4.11  illustrates  the  number  of  people  supervised 


TABLE  4.10 


Job  Tenure  of  Graduate  Respondents 
Currently  Holding  Contracting  Jobs 


Time 

Number 

% 

1  year 

or  less 

31 

Over  1 

year  but  less 

than  2  yrs  17 

Over  2 

years  but  less 

than  3  yrs  11 

3  years 

or  over 

2 

3.2 

Total 

61 

100.0 

by  AFIT  CAM  graduates  currently  holding  contracting  related 
jobs.  Among  the  AFIT  CAM  graduate  respondents  currently  hold¬ 
ing  contracting/manufacturing  assignments,  a  majority  (62.3 
percent)  supervise  five  or  less  people  (see  Table  4.11). 
However,  a  sizeable  plurality  (40.9  percent)  of  AFIT  CAM 
graduates  do  not  supervise  any  people. 

TABLE  4.11 

Number  of  People  Supervised  by  AFIT  CAM  Graduates 
Currently  Holding  Contracting  Related  Jobs 


No.  of 

People  Supervised 

Respondents 

4 

0 

25 

40.9 

1-5 

13 

21.4 

6-10 

8 

13.2 

11-15 

6 

9.8 

16-20 

3 

4.9 

Over  20 

6 

9.8 

Total 

61 

100.0 

Tables  4.12  and  4.13  display  assignments  of  active  duty 
AFIT  CAM  graduate  respondents  by  Major  Command  or  other  desig¬ 
nation:  1)  prior  to  entering  AFIT;  2)  immediately  following 

84 


k. 


AFIT;  and  3)  current  assignment.  A  majority  (74.1  percent) 
of  AFIT  CAM  graduate  respondents  were  assigned  to  four  Air 
Force  Major  Commands  immediately  prior  to  entering  AFIT  CAM: 
the  Strategic  Air  Command  (SAC),  23.4  percent;  Air  Force  Sys¬ 
tems  Command  (AFSC) ,  20.8  percent;  Military  Airlift  Command 
(MAC),  15.6  percent;  and  Air  Force  Logistics  Command  (AFLC) , 
14.6  percent (see  Tables  4.12  and  4.13).  A  majority  (81.8 
percent)  were  assigned  to  either  AFSC  (61.0  percent)  or  AFLC 
(20.8  percent)  following  graduation.  A  plurality  (48.1  per¬ 
cent)  of  graduate  respondents  are  currently  assigned  to  either 
Air  Force  Systems  Command  (AFSC),  35.1  percent,  or  Air  Force 
Logistics  Command  (AFLC),  13.0  percent. 

TABLE  4.12 


Graduate  Respondent  Assignments  By  Major 
Command  or  Other  Designation  (by  Number) 


Assignment 

Prior  to 
AFIT 

Following 

AFIT 

Currently 

Assigned 

AFSC 

16 

47 

27 

AFLC 

11 

16 

10 

AFCS 

3 

3 

3 

ADC 

1 

1 

0 

ATC 

3 

0 

4 

AU 

0 

0 

2 

DLA 

1 

3 

6 

HQ  USAF 

3 

0 

1 

MAC 

12 

2 

6 

PACAF 

2 

0 

0 

SAC 

18 

2 

4 

TAC 

3 

0 

3 

USAFE 

1 

3 

5 

Other 

3 

0 

6 

Total 

77 

77 

77 

Within  the  "Other"  category  of  Table  4.12,  two  of  the  nine 
graduate  respondents  failed  to  completely  specify  their 
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TABLE  4.13 


Graduate  Respondent  Assignments  by  Major  Command 
or  Other  Designation  (by  Percentage) 


Assignment 

Prior  to 
AFIT 

Following 

AFIT 

Currently 

Assigned 

AFSC 

20.8 

61.0 

35.1 

AFLC 

14.3 

20.8 

13.0 

AFCS 

3.9 

3.9 

3.9 

ADC 

1.3 

1.3 

0 

ATC 

3.9 

0 

5.2 

AU 

0 

0 

2.6 

DLA 

1.3 

3.9 

7.8 

HQ  USAF 

3.9 

0 

1.3 

MAC 

15.6 

2.6 

7.8 

PACAF 

2.6 

0 

0 

SAC 

23.4 

2.6 

5.2 

TAC 

3.9 

0 

3.9 

USAFE 

1.3 

3.9 

6.5 

Other 

3.9 

0 

7.8 

Total 

100.0 

100.0 

100.0 

assignment  prior  to  entering  AFIT.  The  remaining  seven  res 
pondents  categorized  assignments  as  listed  in  Table  4.14. 

TABLE  4.14 


Seven  Graduate  Respondent  Job  Descriptions/ 
"Other"  Category  (by  Number) 


Assignment 

Prior  to 
AFIT 

Following 

AFIT 

Currently 

Assigned 

Air  Force  Courier  Service 

1 

0 

0 

Special  Assignment,  Office 
of  Secretary  of  Defense 

0 

0 

1 

AFELM 

0 

0 

1 

AFTEC 

0 

0 

1 

CINCLINT 

0 

0 

1 

NATO 

0 

0 

2 

Total 


0 


6 


Within  the  Major  Command  or  "Other"  assignment  desig¬ 
nations,  graduate  respondents  categorized  the  current  level 


of  their  assignments  as  listed  in  Table  4.15.  Although  a 
plurality  (22.1  percent)  of  graduate  respondents  are  present¬ 
ly  assigned  at  the  Numbered  Air  Force  level,  the  bulk  of 
graduate  respondents  are  assigned  equitably  throughout  all 
levels  of  Air  Force  command  (see  Table  4.15) 

TABLE  4.15 

Graduate  Respondent  Level  of  Assignment 


Assignment 

Number 

% 

Squadron  or  below 

11 

14.3 

Group 

4 

5.2 

Wing 

10 

13.0 

Air  Division 

6 

7.8 

NAF 

17 

22.1 

MAJCOM 

15 

19.5 

HQ  USAF 

1 

1.3 

Special  Assignment 

13 

16.8 

Total 

77 

100.0 

Table  4.16  illustrates  the  number  of  active  duty  mili¬ 
tary/civilian  AFIT  graduate  respondents  having  contracting 
experience  prior  to  entering  the  AFIT  CAM  program.  The  major¬ 
ity  of  AFIT  CAM  respondents  had  no  contracting  experience 
prior  to  entering  the  AFIT  CAM  program. 

TABLE  4.16 


Graduate  Contracting/Manufacturing  Experience  Prior 
to  Entering  the  AFIT  CAM  Program 


Number 

1 

Experience 

28 

36.4 

No  Experience 

49 

63.6 

Total 

77 

100.0 

r 


Table  4.17  illustrates  attendance  at  Lowry  AFB/Ft. 
Belvoir  by  AFIT  CAM  respondents  having  pre-AFIT  CAM  contract¬ 
ing  experience.  Of  those  28  AFIT  CAM  graduate  respondents 
with  contracting  experience  prior  to  entering  AFIT  CAM  (see 
Table  4.16),  a  vast  majority  (82.1  percent)  attended  a  basic 
technical  contracting  course  at  Lowry  AFB  or  Ft.  Belvoir 
either  prior  to  or  following  their  AFIT  CAM  assignment  (see 
Table  4.17) 


TABLE  4.17 

Respondents  With  Pre-AFIT  CAM  Contracting 
Experience:  Attendance  at  Lowry  AFB/Ft.  Belvoir 


Attendance 

Number 

% 

Before  AFIT  CAM 

21 

75.0 

After  AFIT  CAM 

2 

7.1 

Never 

5 

17.9 

Total 

28 

100.0 

Table  4.18  displays  attendance  at  Lowry  AFB/Ft.  Belvoir 
for  graduate  respondents  without  pre-AFIT  CAM  contracting  ex¬ 
perience.  Of  those  49  AFIT  CAM  graduate  respondents  without 
previous  contracting  experience  (see  Table  4.16),  59.2  per¬ 
cent  attended  a  technical  contracting  course  at  Lowry  AFB  or 
Ft.  Belvoir  either  prior  to  or  following  their  AFIT  CAM 
assignment  (see  Table  4.18). 

A  majority  (75.3  percent)  of  graduate  respondent  job 
assignments  since  graduation  from  the  AFIT  CAM  program  have 
been  in  a  contracting- related  field.  However,  a  sizeable 
plurality  (49.4  percent)  of  graduate  respondents  have  held 
only  one  contracting-related  assignment.  Tables  4.19  and 


4.20  illustrate  these  points. 


TABLE  4.18 


Respondents  Without  Pre-AFIT  CAM  Contracting 
Experience:  Attendance  at  Lowry  AFB/Ft.  Belvoir 


Attendance 

Number 

% 

Before  AFIT  CAM 

6 

12.3 

After  AFIT  CAM 

23 

46.9 

Never 

20 

40.8 

Total 

49 

100.0 

TABLE  4.19 

Graduate  Respondent  Contracting/Non- 

Contracting 

Assignments  Since 

AFIT  CAM  Graduation 

Assignment 

Number 

% 

Contracting  Related 

58 

75.3 

Non-Contracting  Related 

19 

24.7 

Total 

77 

100.0 

TABLE  4.20 


Number  of  Graduate  Respondent  Contracting- Related 
Assignments  Since  AFIT  CAM  Graduation 


Contracting-Related  Jobs  Held 

Number 

% 

1 

38 

49.4 

2 

24 

31.2 

3 

6 

7.8 

4  or  more 

8 

10.4 

None 

1 

1.3 

Total 

77 

100.0 

Table  4.21  highlights  current  graduate  respondent  con¬ 
tracting/manufacturing  experience  levels.  The  majority  of 
AFIT  CAM  graduate  respondents  (59.7  percent)  have  less  than 
five  years  of  contracting/manufacturing  experience  (see 
Table  4.21).  However,  a  sizeable  plurality  (44.2  percent) 
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have  three  or  less  years  of  contracting/manufacturing  experi¬ 
ence. 


TABLE  4.21 

Graduate  Respondent  Contracting/Manufacturing 
Experience  Levels 


Experience 

Number 

% 

3  years  or  less 

34 

44.2 

Over  3  yrs  but  less 

than 

5 

12 

15.5 

Over  5  yrs  but  less 

than 

8 

14 

18.2 

Over  8  yrs  but  less 

than 

11 

10 

13.0 

Over  11  yrs 

7 

9.1 

Total 

77 

100.0 

The  researchers  believed  that  the  observations  drawn 
from  Tables  4.10,  4.11,  4.16,  4.20,  and  4.21  resulted  direct¬ 
ly  from  the  higher  survey  response  rate  obtained  from  recent 
AFIT  CAM  classes  (see  Table  4.1).  The  reader  is  cautioned 
against  making  erroneous  observations  concerning  the  demo¬ 
graphic  profile  of  the  entire  AFIT  CAM  graduate  population 
based  on  these  five  tables. 

Table  4.22  highlights  the  levels  of  contracting  assign¬ 
ments  (base,  central,  systems,  or  a  combination  of  these)  for 
AFIT  CAM  graduate  respondents.  A  sizeable  plurality  (46.7 
percent)  of  graduate  respondent  assignments  were  at  the  major 
systems  level  of  acquisitions  (see  Table  4.22). 

Table  4.23  displays  current  graduate  respondent  educa¬ 
tional  levels.  Only  27.3  percent  of  AFIT  CAM  graduate  res¬ 
pondents  have  pursued  postgraduate  education  above  the  master's 
degree  level  (see  Table  4.23).  No  graduate  respondents  from 
the  survey  have  earned  a  doctorate  degree.  It  should  be 
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TABLE  4.22 


Graduate  Respondent  Assignments  By 
Level  of  Acquisition 


Level  of  Acquisition 

Number 

% 

Base 

5 

6 . 5 

Central 

8 

10.4 

Systems 

36 

46.7 

All  the  above 

6 

7.8 

Base  and  Central 

4 

5.2 

Base  and  Systems 

4 

5.2 

Central  and  Systems 

14 

18.2 

Total 

77 

100.0 

noted,  however,  that  at  least  one  AFIT  CAM  graduate  had  a 
doctorate  degree  at  the  time  of  this  research  effort.  This 
AFIT  CAM  graduate,  who  is  a  member  of  the  current  AFIT  CAM 
faculty,  was  purposely  excluded  from  the  survey  target  popu¬ 
lation  as  discussed  in  Chapter  3  (Research  Methodology). 

TABLE  4.23 


Current  Graduate  Responlent  Educational  Levels 


Degree 

Number 

% 

Masters 

56 

72.7 

Masters  plus  additional 

10 

13.0 

graduate  work 

More  than  one  Masters 

11 

14.3 

Doctorate 

0 

0 

Total 

77 

100.0 

Table  4.24  shows  the  number  of  contracting- related 
AFIT  Professional  Continuing  Education  (PCE)  courses  attended 
by  graduate  respondents  since  graduating  from  the  AFIT  CAM 
program.  A  majority  (53. 3  percent)  of  AFIT  CAM  graduate  res¬ 
pondents  attended  one  or  more  contracting- related  PCE  courses 
following  graduation  from  the  AFIT  CAM  program  (see  Table  4.24) 
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TABLE  4.24 


AFIT  PCE  Courses  Attended  By  Graduate 
Respondents  Following  AFIT  CAM  Program 


PCE  Courses  Attended 

Number 

% 

0 

36 

46.7 

1 

13 

16.9 

2 

9 

11.7 

3 

6 

7.8 

4  or  more 

13 

16.9 

Total 

100.0 

Finally,  a  majority  of  AFIT  CAM  respondents  have  yet 
to  achieve  other  forms  of  professional  contracting  accredita¬ 
tion.  Only  9  of  77  (11.7  percent)  of  graduate  respondents 
have  published  at  least  one  article  in  a  professional  con¬ 
tracting  or  logistics  journal  since  graduation  from  the  AFIT 
CAM  program.  The  journals  cited  by  respondents  included  the 
Air  Force  Academy  Journal,  Air  Force  Journal  of  Logistics, 
Defense  Systems  Management  Journal,  and  National  Contract 
Management  Association  Journal.  Additionally,  15  of  77  res¬ 
pondents  (19.5  percent)  have  obtained  a  professional  contract¬ 
ing  designation  (e.g.,  the  National  Contract  Management  Asso¬ 
ciation's  Certified  Professional  Contract  Manager  designation) 
since  graduation  from  the  AFIT  CAM  program. 

Curriculum  Ranking 
Research  Question  Three 

What  are  the  most/least  useful  subject  areas  in  the 

AFIT  CAM  curriculum  as  perceived  by  active  duty  Air  Force 
military  and  civilian  graduates  and  their  supervisors? 
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A  battery  of  questions  were  used  on  both  the  graduate 
and  supervisor  questionnaires  to  determine  the  most/ieast  use¬ 
ful  subject  areas  taught  in  the  AFIT  CAM  curriculum.  For  grad¬ 
uates  ,  survey  Questions  31-61,  63,  and  68  were  analyzed;  for 
supervisors,  survey  Questions  10-41  and  43  were  analyzed.  The 
median  response  was  calculated  for  each  question  from  both 
groups  of  respondents.  The  resulting  median  scores  were  then 
ranked  from  most  to  least  useful.  Subject  areas  with  tied 
median  scores  were  ranked  equally.  Tables  4.25  and  4.26  sum¬ 
marize  the  question  number,  subject  area,  overall  median  res¬ 
ponse,  and  ranking  of  courses  from  most  to  least  useful  for 
graduates  and  supervisors,  respectively.  For  each  table,  the 
smaller  the  ranking  number,  the  more  useful  the  course.  Courses 
with  equal  rank  were  listed  alphabetically.  Thus,  there  is 
no  significance  to  the  ordering  of  the  courses  with  equal 
median  scores  and  ranking  as  listed  in  Tables  4.25  and  4.26. 

The  following  observations  were  made  based  on  the  data 
presented  in  Tables  4.25  and  4.26.  In  general,  AFIT  CAM  gradu¬ 
ate  and  supervisor  respondents  found  the  AFIT  CAM  curriculum 
useful  in  postgraduate  assignments.  Graduate  respondents 
found  fourteen  of  the  eighteen  AFIT  CAM  curriculum  courses 
(77.7  percent)  useful  (see  Table  4.25).  Supervisor  respondents 
found  sixteen  of  the  eighteen  AFIT  CAM  curriculum  courses  (83.3 
percent)  useful.  The  researchers  categorized  courses  with 
median  scores  greater  than  four,  or  "Undecided,"  as  useful. 

AFIT  CAM  graduate  respondents  ranked  the  five  contract¬ 
ing  specific  courses  among  the  most  useful  courses  in  the  AFIT 
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TABLE  4.25 


Graduate  Respondent  Course  Rankings 


Question  # 

Subject  Area 

Median 

Rank 

55,56,59 

Contract  Management  Theory 

7.0 

1 

53,54 

Contract  Law 

6.5 

2 

50 

Contracting  §  Acquis.  Mgt. 

6.0 

3 

47,51,52,60 

Cost  and  Price  Theory 

6.0 

3 

33,44 

Organizational  Behavior 

6.0 

3 

57,58,61 

Seminar  in  Acquisition  Mgt. 

6.0 

3 

32 

Accounting  (review  term) 

5.0 

4 

36 

Distribution  Management 

5.0 

4 

48 

Economic  Analysis  § 

Public  Policy 

5.0 

4 

35 

Federal  Financial  Mgt. 

5.0 

4 

38 

International  Logistics 
Overview 

5.0 

4 

31 

Quantitative  Methods 
(review  term) 

5.0 

4 

46,68 

Research  8  Technical  Writing 

5.0 

4 

63 

Thesis 

49 

Quantitative  Decision  Making 

4.0 

5 

34,41 

Statistics  I  §  II 

4.0 

5 

42,43 

Intro,  to  Computer  (review 
term) 

3.5 

6 

37,39,40 

Production  §  Maint.  Mgt. 

3.0 

7 

CAM  curriculum  (see  Table  4.25).  Graduate  respondents  ranked 
Contract  Management  Theory  as  the  most  useful  course  among  all 
courses  in  the  AFIT  CAM  curriculum.  Graduates  ranked  Contract 
Law  as  the  second  most  useful  course.  Graduate  respondents 
ranked  the  courses  Contracting  and  Acquisition  Management, 

Cost  and  Price  Theory,  and  Seminar  in  Acquisition  Management 
equally  as  the  third  most  useful  courses  in  the  AFIT  CAM  curri 
culum.  Graduates  also  ranked  one  non- contracting  specific 


94 


TABLE  4.26 


Supervisor  Respondent  Course  Rankings 


Question  # 

Subject  Area 

Median 

Rank 

30 

Contracting  5  Acquis.  Mgt. 

7.00 

1 

35,36,39 

Contract  Management  Theory 

7.00 

1 

37,38,41 

Seminar  in  Acquisition  Mgt. 

7.00 

1 

33 , 34 

Contract  Law 

6.50 

2 

13,24 

Organizational  Behavior 

6.50 

2 

27,31,32,40 

Cost  §  Price  Theory 

6.00 

3 

11 

Quantitative  Methods 
(review  term) 

6.00 

3 

26,43 

Research  5  Technical  Writing 

6.00 

3 

10 

Accounting  (review  term) 

5.00 

4 

28 

Economic  Analysis  §  Public 
Policy 

5.00 

4 

15 

Federal  Financial  Mgt. 

5.00 

4 

18 

International  Logistics 
Overview 

5.00 

4 

17,19,20 

Production  §  Maint.  Mgt. 

5.00 

4 

12 

Quantitative  Decision 

Making 

5.00 

4 

14,21 

Statistics  I  8  II 

5.00 

4 

29 

Thesis 

5.00 

4 

22,23 

Intro,  to  Computer  (review 
term) 

3 .  50 

5 

16 

Distribution  Management 

3.00 

6 

course,  Organizational  Behavior,  equally  with  those  courses 
tied  for  third  most  useful. 

Supervisor  respondents  ranked  the  five  contracting 
specific  courses  among  the  most  useful  courses  in  the  AFIT 
CAM  curriculum  (see  Table  4.26).  Supervisor  respondents 
agreed  with  graduate  respondents  in  ranking  Contract  Manage¬ 
ment  Theory  among  the  most  useful  courses.  Supervisors, 
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however,  ranked  two  additional  courses,  Contracting  and  Acqui¬ 
sition  Management  and  Seminar  in  Acquisition  Management,  equally 
as  the  most  useful  courses.  Supervisor  respondents  also  agreed 
with  graduate  respondents  in  ranking  Contract  Law  among  the 
second  most  useful  courses.  Supervisors  also  ranked  Organiza¬ 
tional  Behavior  as  the  second  most  useful  course.  Supervisor 
respondents  ranked  Cost  and  Price  Theory  equally  with  Quanti¬ 
tative  Methods  and  Research  and  Technical  Writing  as  the  third 
most  useful  courses. 

All  AFIT  CAM  curriculum  courses  ranked  as  least  useful 
by  graduate  and  supervisor  respondents  were  non- contracting 
specific  courses.  AFIT  CAM  graduate  respondents  ranked  Pro¬ 
duction  and  Maintenance  Management  as  the  least  useful  course 
among  all  courses  in  the  AFIT  CAM  curriculum.  Supervisors 
disagreed,  ranking  Distribution  Management  as  the  least  use¬ 
ful  course.  However,  both  graduate  and  supervisor  respondents 
ranked  the  Introduction  to  Computer  course  next  to  last  in 
terms  of  usefulness. 

It  should  be  noted  that  inconsistency  existed  in  AFIT 
CAM  graduate  and  supervisor  respondent  rankings  for  the  least 
useful  courses  (see  Tables  4.25  and  4.26).  Whereas  graduate 
respondents  ranked  Production  and  Maintenance  Management  as 
the  least  useful  AFIT  CAM  curriculum  course,  supervisor  res¬ 
pondents  found  this  course  useful.  When  supervisor  respond¬ 
ents  ranked  Distribution  Management  as  the  least  useful  course 
in  the  AFIT  CAM  curriculum,  graduate  respondents  found  this 
course  useful. 
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Open-Ended  Questions 


Part  III  of  both  graduate  and  supervisor  questionnaires 
(see  Appendices  A  and  B)  contained  questions  which  afforded 
respondents  an  opportunity  to  identify  those  topics  or  sub¬ 
ject  areas  which  warranted  increased  emphasis  in  the  AFIT  CAM 
curriculum.  Graduates  were  also  asked  to  list  topics  or  sub¬ 
ject  areas  which  warranted  decreased  emphasis  in  the  AFIT  CAM 
curriculum.  Supervisors  were  asked  to  identify  those  areas 
in  which  the  AFIT  CAM  graduate  subordinates  were  strongest 
and  weakest.  Questions  69  and  70  for  graduates  (see  Appendix 
A)  and  Questions  45  and  46  for  supervisors  (see  Appendix  B) 
were  the  applicable  open-ended  response  questions  for  each 
group. 

In  Tables  4.27-4.30,  topics  are  listed  in  alphabetical 
order.  No  attempt  was  made  to  determine  relative  importance 
or  ranking  among  topics.  Table  4.27  displays  topics  or  sub¬ 
ject  areas  needing  increased  emphasis  in  the  AFIT  CAM  curri¬ 
culum  as  suggested  by  graduates.  These  topics  are  categorized 
into  two  broad  groups:  contracting  and  non- contracting  related 
topics.  Table  4.28  displays  subject  areas/topics  requiring 
less  emphasis  as  viewed  by  graduate  respondents.  Table  4.29 
displays  subject  areas/topics  requiring  increased  emphasis  as 
viewed  by  supervisor  respondents. 

In  Table  4.30,  supervisor  respondents  identified  the 
primary  strengths  and  weaknesses  concerning  their  AFIT  CAM 
subordinates . 


97 


TABLE  4.27 


Graduate  Respondents:  AFIT  CAM  Subject  Areas 
Needing  Increased  Emphasis 


Contracting  Related 

Non- Contracting  Related 

Acquisition  Strategies 

Contract  Administration 

Contract  Files 

Contract  Types 

Contracting  Process 

Contractor  Financing/ 
Marketing  Management 

Contractor  Motivation 

Cost/Price/Risk  Analysis 

Defense  Acquisition  Regu¬ 
lation  Clauses 

Defense  Industrial  Base 

Determination  §  Findings 

Interface  with  SPOs 

a.  Configuration  Mgt. 

b.  Integrated  Logistics 

Support 

Manufacturing/Quality 

Assurance 

Negotiations 

Small  Business  Contracting 

Software  Acquisition 

SPO/AFPRO  Interface 

Systems  Acquisition  Process 

Systems  Contracting  vs. 
Central  and  Base 

Communication  Skills 

a.  Speech 

b.  Writing 

Economics 

Federal  Financial  Management 
International  Logistics 

Use  of  Computer  Output 

l 

J 
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TABLE  4.28 


Graduate  Respondents:  AFIT  CAM  Subject  Areas 
Needing  Less  Emphasis 


Contracting  Related 

Non- Contracting  Related 

None 

Distribution  Management 

Production  §  Maintenance 

Mgt. 

Quantitative  Decision  Making 

Statistics  I  5  II 

Thesis/Research  Efforts 

TABLE  4.29 

Supervisor  Respondents:  AFIT  CAM  Subject  Areas 
Needing  Increased  Emphasis 


Contracting  Related 

Non-Contracting  Related 

Business  Strategies 
Commercial  Buying 

Contract  Law 

Contract  Management 

Contract  Planning 

Cost  §  Price  Analysis 

Interface  within  SPOs 

Logistics  Command  vs  Sys¬ 
tems  Command  Contracting 

Manufacturing/Quality 

Assurance 

Negotiations 

Program  Management 

Source  Selection  Process 

Accounting 

Communication  Skills 

a.  Speech 

b.  Writing 

Federal  Financial  Management 

a.  Program  Objective 

Memorandum 

b.  Budget  Estimate 

Submittal 

International  Logistics 

Quantitative  Decision 
Techniques 

Supervision 

In  general,  subject  areas  identified  by  graduate  --„s- 
pondents  requiring  increased  emphasis  (see  Table  4.27)  are 
adequately  covered  in  the  current  AFIT  CAM  curriculum.  How¬ 
ever,  two  contracting- related  subject  areas,  Software 
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TABLE  4.-30 


Supervisor  Respondents:  AFIT  CAM  Graduate  Subordinate 
Strength/Weakness  Areas 


Strengths 

Weaknesses 

Acquisition  Process 

Contract  Law 

Manufacturing /Quality 
Assurance 

Problem/Risk  Analysis 

Quantitative  Decision 
Making 

Regulations  (DAR) 

Research 

Communication  Skills 

a.  Speech 

b.  Writing 

Federal  Financial  Mgt. 
Incentive  Arrangements 
Negotiation 

Use  of  Computer  Output 

Acquisition  and  Small  Business  Contracting,  are  not  suffici¬ 
ently  covered  within  the  existing  AFIT  CAM  curriculum. 
Graduate  respondents  also  listed  one  non-contracting  related 
subject  area,  Speech,  which  is  not  adequately  covered  within 
the  existing  AFIT  CAM  curriculum.  Although  one  speech  course 
Speech  for  Military  Managers,  is  available  to  AFIT  CAM  stu¬ 
dents,  this  course  is  an  elective  and  not  a  required  course 
within  the  existing  AFIT  CAM  curriculum. 

In  general,  subject  areas  listed  by  supervisor  respond 
ents  requiring  increased  emphasis  (see  Table  4.29)  are  ade¬ 
quately  covered  by  the  current  AFIT  CAM  curriculum.  Like  the 
graduate  respondents,  however,  supervisors  identified  Speech 
as  a  subject  area  requiring  increased  emphasis.  Thus,  there 
was  agreement  between  graduate  and  supervisor  respondents 
concerning  the  importance  of  speaking  ability  in  on-the-job 
performance;  however,  Speech  is  not  a  required  course  within 


100 


the  existing  AFIT  CAM  curriculum. 

AFIT  CAM  graduate  respondents  did  not  identify  any 
subject  areas  covered  by  the  five  specific  contracting  courses 
as  requiring  less  emphasis  in  future  course  offerings  (see 
Table  4.28).  However,  graduate  respondents  identified  five 
non-contracting  subject  areas  requiring  less  emphasis: 
Distribution  Management,  Production  and  Maintenance  Manage¬ 
ment,  Quantitative  Decision  Making,  Statistics  I  and  II,  and 
Thesis/Research  Efforts.  With  the  exception  of  Distribution 
Management  and  Thesis/Research  Efforts,  these  subject  areas 
correspond  with  three  of  the  four  least  useful  graduate  course 
rankings  (see  Table  4.25).  Supervisors  were  not  asked  to 
identify  subject  areas  requiring  less  emphasis  in  future  AFIT 
CAM  curriculum  offerings. 

Supervisor  respondents  found  AFIT  CAM  subordinates  weak 
in  four  areas  (see  Table  4.30)  which,  with  one  exception,  cor¬ 
responded  with  subject  areas  they  identified  as  requiring 
increased  emphasis  in  future  AFIT  CAM  curriculum  offerings 
(see  Table  4.29);  Communication  Skills  (Speech  and  Writing), 
Negotiation,  Federal  Financial  Management,  and  Incentive 
Arrangements.  Supervisors  also  cited  AFIT  CAM  graduate  weak¬ 
nesses  in  the  Use  of  Computer  Output  (see  Table  4.30).  How¬ 
ever,  supervisors  did  not  previously  cite  computer  output 
utilization  as  requiring  increased  emphasis  in  the  AFIT  CAM 
curriculum  (see  Table  4.29). 

The  survey  instrument  questions  for  Research  Question 
Three  were  written  in  terms  of  usefulness  to  the  respondent's 
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job.  As  such,  a  low  usefulness  ranking  of  a  course  or 
suggested  de-emphasis  of  a  particular  subject  area  should  not 
be  interpreted  that  the  course  or  subject  area  is  inappropri¬ 
ate  for  the  entire  School  of  Systems  and  Logistics.  A  better 
interpretation  would  be  that  the  appropriateness  of  the  par¬ 
ticular  course/subject  area  for  the  AFIT  CAM  curriculum 
should  be  reassessed. 

Professional  Continuing  Education  (PCE) 
and  AFIT  CAM 

Question  67  on  the  graduate  survey  (see  Appendix  A) 
and  Question  44  on  the  supervisor  survey  (see  Appendix  B) 
measured  whether  respondents  believed  that  incorporation  of 
contracting- related  (PCE)  courses  would  improve  the  overall 
usefulness  of  the  AFIT  CAM  program.  The  median  response  of 
graduate  respondents  was  five,  or  "Slightly  Agree."  The 
median  response  of  supervisor  respondents  was  six,  or  "Agree." 
Tables  4.31  and  4.32  illustrate  individual  responses  from 
graduate  and  supervisor  respondents  to  these  two  questions. 


TABLE  4.31 

Graduate  Response  to  Incorporating  PCE 
Into  AFIT  CAM  Curriculum 


Response 

Number 

% 

Strongly  Disagree 

1 

1.3 

Disagree 

7 

9.0 

Slightly  Disagree 

6 

7.8 

Undecided 

18 

23.4 

Slightly  Agree 

15 

19.5 

Agree 

18 

23.4 

Strongly  Agree 

12 

15.6 

Total 

77 

100.0 
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TABLE  4.32 


Supervisor  Response  to  Incorporating  PCE 
Into  AFIT  CAM  Curriculum 


Response 

Number 

% 

Strongly  Disagree 

0 

0 

Disagree 

1 

2.4 

Slightly  Disagree 

0 

0 

Undecided 

7 

17.1 

Slightly  Agree 

4 

9.8 

Agree 

17 

41.5 

Strongly  Agree 

12 

29.2 

Total 

41 

100.0 

As  evidenced  from  Tables  4.31  and  4.32,  both  graduate  (58.5 
percent)  and  supervisor  (80. 5  percent)  respondents  indicated 
some  form  of  agreement  (i.e.,  Strongly  Agree,  Agree,  or 
Slightly  Agree)  to  the  incorporation  of  contracting- related 
PCE  courses  into  the  AFIT  CAM  curriculum  to  improve  the  over¬ 
all  usefulness  of  the  AFIT  CAM  program. 

Summary 

The  data  analysis  chapter  revealed  that  73.3  percent 
of  the  graduates  and  52.6  percent  of  the  supervisors  surveyed 
responded  to  the  questionnaires.  Contingency  table  analysis 
validated  all  of  the  usefulness  questions.  A  series  of  non- 
parametric  statistical  tests,  numerical  tables,  and  usefulness 
ranking  of  the  AFIT  CAM  curriculum  were  utilized  to  evaluate 
all  three  research  questions  formulated  in  Chapter  1. 

Finally,  the  researchers  were  able  to  identify  key  observations 
from  responses  to  the  open-ended  questions.  In  the  final 
chapter  that  follows,  the  researchers  provide  several  substan¬ 
tive  conclusions  and  recommendations. 
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CHAPTER  5 


SUMMARY,  CONCLUSIONS,  AND  RECOMMENDATIONS 
Introduction 

The  purpose  of  this  chapter  is  to  present  the  results 
of  the  authors'  research  effort.  First,  the  researchers  will 
restate  the  three  basic  research  questions  identified  in 
Chapter  1  and  summarize  the  research  methodology  used  in  the 
study.  Second,  the  researchers  present  several  substantive 
conclusions  drawn  from  the  research  project.  Finally,  re¬ 
search  recommendations  relating  to  the  AFIT  CAM  program  and 
recommendations  for  future  follow-on  research  efforts  are 
identified. 


Research  Design  Summary 

The  three  research  questions  described  in  Chapter  1 
provided  the  overall  framework  for  this  research  effort: 

1.  What  are  the  perceptions  of  active  duty  Air  Force 
military  and  civilian  AFIT  CAM  graduates  and  their 
supervisors  regarding  the  usefulness  of  a  gradu¬ 
ate  AFIT  CAM  education  in  postgraduate  assignments? 

2.  What  is  the  demographic  profile  of  active  duty  Air 
Force  military  and  civilian  AFIT  CAM  graduates? 

3.  What  are  the  most/least  useful  subject  areas  in 
the  AFIT  CAM  curriculum  as  perceived  by  active  duty 


Air  Force  military  and  civilian  graduates  and  their 
supervisors? 

Data  were  collected  by  means  of  questionnaires  mailed 
to  a  target  population  of  105  active  duty  Air  Force  military 
and  civilian  AFIT  CAM  graduates  and  78  of  their  immediate  super¬ 
visors.  Valid  responses  were  obtained  from  77  (73.3  percent) 
of  the  graduates  and  41  (52.6  percent)  of  the  supervisors. 

The  researchers  analyzed  the  data  in  accordance  with 
the  research  methodology  outlined  in  Chapter  3.  The  key 
points  of  the  authors'  research  methodology  included: 

1.  Contingency  table  analysis  to  validate  usefulness 
Questions  26-30  and  62  in  the  graduate  survey  (see 
Appendix  A)  and  Questions  5-9  and  42  in  the  supervisor 
survey  (see  Appendix  B) ; 

2.  Nonparametric  statistical  tests  used  to  answer  Research 
Question  One  which  consisted  of: 

a.  The  Wilcoxon  Sign-Rank  Test  performed  on  graduate 
median  responses  to  Questions  26-30  and  62. 

b.  The  Wilcoxon  Sign-Rank  Test  performed  on  super¬ 
visor  median  responses  to  Questions  5-9  and  42. 

c.  The  Wilcoxon  Rank  Sum  Test  performed  using  gradu¬ 
ate  and  supervisor  median  responses  to  Questions 
26-30  and  62  (graduates)  and  Questions  5-9  and 

42  (supervisors) . 

d.  The  Spearman  Nonparametric  Test  for  Rank  Correla¬ 
tion  performed  with  graduate  respondent  cumula¬ 
tive  scores  to  Questions  26-30  and  62  against 
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length  of  time  since  graduation. 


3.  Nineteen  numerical  tables  that  presented  a  demographic 
profile  of  AFIT  CAM  graduate  respondents  using  graduate 
survey  Questions  1-25. 

4.  Rank  ordering  of  most/least  useful  subject  areas  by 
ranking  median  responses  of  graduates  and  supervisors 

to  Questions  31-61,  63,  and  68  (graduates)  and  Questions 
10-41,  and  43  (supervisors). 

5.  Subjective  analysis  and  categorization  of  graduate  and 
supervisor  responses  to  survey  open-ended  Questions  69 
and  70  (graduates)  and  Questions  45  and  46  (supervi¬ 
sors)  . 

6.  Presentation  of  graduate  and  supervisor  responses  to 
Question  67  (graduates)  and  44  (supervisors)  which 
measured  opinions  concerning  possible  incorporation  of 
contracting  related  Professional  Continuing  Education 
courses  into  the  AFIT  CAM  curriculum. 

Conclusions 

The  final  conclusions  of  this  research  effort  are  con¬ 
tained  in  five  sections:  Perceptions,  Demographics,  Curri¬ 
culum  Rankings,  Open-Ended  Questions,  and  Professional  Con¬ 
tinuing  Education.  The  Perceptions,  Demographics,  and 
Curriculum  Ranking  sections  address  Research  Question  One, 

Two  and  Three,  respectively.  The  Open-Ended  and  Professional 
Continuing  Education  sections  of  this  chapter  provided  addi¬ 
tional  feedback  and  recommendations  from  field  organizations 
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that  utilize  AFIT  CAM  graduates. 


Prior  to  accepting  the  conclusions  of  this  research, 
the  reader  should  review  the  assumptions  and  limitations 
listed  in  Chapter  3.  In  addition,  it  should  be  noted  that 
the  research  conclusions  apply  only  to  the  two  respondent 
groups  of  77  graduates  and  41  supervisors.  Inferences  to  any 
overall  population  were  neither  attempted  nor  implied. 

Perceptions 

A  summary  list  of  AFIT  CAM  graduates’  and  their  super¬ 
visors’  perceptions  of  the  overall  usefulness  of  the  AFIT  CAM 
graduate  education  program  is  provided  below: 

1.  Graduate  respondents  believed  that  the  AFIT  CAM  program 
was  useful  in  postgraduate  assignments.  This  research 
conclusion  was  statistically  supported  by  the  results 
of  the  Wilcoxon  Sign-Rank  Test  discussed  in  Chapter  4. 

2.  Supervisor  respondents  perceived  that  the  AFIT  C\M  pro¬ 
gram  was  useful  to  subordinates  in  postgraduate  assign¬ 
ments.  This  research  conclusion  was  statistically 
supported  by  the  results  of  the  Wilcoxcn  Sign-Rank  Test 
described  in  Chapter  4. 

3.  AFIT  CAM  graduate  respondents  and  their  immediate  super¬ 
visors  did  not  display  a  significant  difference  of 
opinion  regarding  the  usefulness  of  the  AFIT  CAM  program 
in  postgraduate  assignments.  That  is,  graduate  respond¬ 
ents  did  not  find  the  AFIT  CAM  program  more  useful  than 
did  supervisors,  nor  vice  versa.  This  research  conclusion 


was  statistically  supported  by  the  results  of  the 
Wilcoxon  Rank  Sum  Test  described  in  Chapter  4. 

4.  Graduate  respondent  perceptions  of  AFIT  CAM  program 
usefulness  have  not  changed  over  time.  That  is,  there 
was  no  empirical  evidence  available  to  suggest  that 
graduate  respondents  found  an  AFIT  CAM  education  to  be 
more  or  less  useful  over  time.  This  research  conclu¬ 
sion  was  statistically  supported  by  the  results  of  the 
Spearman  Nonparametric  Test  for  Rank  Correlation  des¬ 
cribed  in  Chapter  4.  Furthermore,  an  informal  compari¬ 
son  of  graduate  responses  to  survey  Questions  64,  65, 
and  66  (see  Appendix  A)  with  the  results  of  the 
Spearman  Test  supported  the  statistical  conclusion. 

Demographics 

A  summary  list  of  the  researchers'  conclusions  related 
to  the  demographic  profile  of  AFIT  CAM  graduate  respondents 
is  provided  below: 

1.  The  researchers  concluded  that  a  sizeable  plurality  of 
the  total  graduate  survey  response  consisted  of  res¬ 
ponses  from  graduates  completing  the  AFIT  CAM  program 
within  the  last  three  years.  This  fact  skewed  the 
demographic  results  toward  the  more  recent  AFIT  CAM 
graduates . 

2.  A  majority  of  AFIT  CAM  graduate  respondents  are  career 
oriented  Air  Force  captains  and  majors  with  approximate¬ 
ly  9-18  years  of  service. 
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3.  A  majority  of  AFIT  CAM  respondents  have  assumed  middle 
level  managerial  roles  in  the  contracting/manufacturing 
career  field,  principally  in  Systems  Contract  Adminis¬ 
tration,  Contract  Negotiation,  and  Manufacturing  posi¬ 
tions.  Many  AFIT  CAM  respondents,  however,  hold  upper 
level  managerial  roles,  principally  in  warranted 
(Principal  Contracting  Officer)  and  contracting  staff 
positions . 

4.  Many  AFIT  CAM  graduate  respondents  are  relatively  inex¬ 
perienced  in  the  contracting/manufacturing  career  field. 

5.  The  majority  of  AFIT  CAM  graduate  respondents  received 
their  initial  exposure  to  the  contracting/manufacturing 
career  field  through  the  AFIT  CAM  program. 

6.  Four  Major  Commands  provided  the  vast  majority  of  offi¬ 
cer  assignment  inputs  to  the  AFIT  CAM  program:  the 
Strategic  Air  Command,  Air  Force  Systems  Command, 
Military  Airlift  Command,  and  Air  Force  Logistics  Com¬ 
mand.  The  Strategic  Air  Command  provided  the  most 
officer  assignment  inputs  to  the  AFIT  CAM  program  among 
all  Major  Commands. 

7.  The  majority  of  AFIT  CAM  graduate  respondents  were 
assigned  to  the  Air  Force  Systems  Command  (AFSC)  immedi¬ 
ately  following  graduation  from  the  AFIT  CAM  program. 

The  majority  of  graduate  respondents  initially  assigned 
to  AFSC  following  graduation  from  AFIT  CAM  currently 
remain  assigned  to  AFSC. 

8.  A  majority  of  AFIT  CAM  graduate  respondents  are  assigned 
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in  the  systems  level  of  acquisition.  This  supports  the 
emphasis  placed  on  systems  acquisition  in  the  AFIT  CAM 
program. 

9.  Attendance  in  contracting- related  Professional  Continu¬ 
ing  Education  courses  and  completion  of  a  basic  techni¬ 
cal  contracting  course  are  important  factors  in  the 
professional  development  of  contract  managers. 

10.  Very  little  emphasis  is  placed  on  the  importance  of 

obtaining  a  professional  contracting  designation  while 
attending  the  AFIT  CAM  program. 

Curriculum  Ranking 

A  summary  list  of  the  researchers'  conclusions  related 
to  the  ranking  of  the  AFIT  CAM  curriculum,  in  terms  of  use¬ 
fulness,  is  provided  below: 

1.  AFIT  CAM  graduate  respondents  ranked  all  contracting 
specific  courses  among  the  most  useful  courses  in  the 
AFIT  CAM  curriculum  in  terms  of  usefulness  in  post¬ 
graduate  assignments. 

2.  Supervisor  respondents  also  ranked  all  contracting  spe¬ 
cific  courses  among  the  most  useful  courses  in  the  AFIT 
CAM  curriculum  in  terms  of  usefulness  to  their  subor¬ 
dinates  in  postgraduate  assignments. 

3.  In  general,  the  AFIT  CAM  graduate  education  program  has 
maintained  subject  area/topic  currency  and  has  met  the 
needs  of  the  Air  Force  contracting/manufacturing 
community. 
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4.  The  AFIT  CAM  graduate  education  program  has  been  effec¬ 
tively  managed  throughout  the  existence  of  the  program. 

5.  Subject  areas  identified  in  Tables  4.25  and  4.26  with 
median  scores  of  four,  "Undecided,"  or  less  did  not 
contain  material  that  was  relevant  to  AFIT  CAM  gradu¬ 
ate  respondents  in  postgraduate  assignments. 

Open-Ended  Questions 

A  summary  list  of  the  researchers'  conclusions  related 
to  the  open-ended  questions  is  provided  below: 

1.  In  general,  the  AFIT  CAM  curriculum  addressed  contract¬ 
ing/manufacturing  issues  of  concern  to  AFIT  CAM  graduate 
and  supervisor  respondents  in  the  field. 

2.  Two  topics,  Software  Acquisition  and  Small  Business 
Contracting,  were  not  adequately  covered  in  the  AFIT  CAM 
curriculum. 

3.  The  AFIT  CAM  curriculum  placed  very  little  emphasis  upon 
the  value  of  public  speaking  ability  in  contracting/ 
manufacturing  postgraduate  assignments. 

4.  Computer  instruction  in  the  AFIT  CAM  curriculum  did  not 
meet  the  needs  of  AFIT  CAM  respondents  in  postgraduate 
contracting/manufacturing  assignments . 

Professional  Continuing  Education  (PCE) 

The  researchers  concluded  that  incorporation  of  selected 
cont ; acting- related  PCE  courses  would  improve  the  overall  use¬ 
fulness  of  the  AFIT  CAM  program. 
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Recommendations 


Based  on  the  overall  research  results  and  conclusions, 
the  authors  have  identified  several  substantive  recommenda¬ 
tions  that  are  presented  in  two  categories:  Recommendations 
for  Implementation  and  Recommendations  for  Future  Research. 

Recommendations  for 
Implementation 

Specific  recommendations  based  on  this  research  that 
should  be  considered  for  implementation  to  enhance  the  useful¬ 
ness  of  the  AFIT  CAM  program  are  listed  below: 

1.  The  AFIT  CAM  Option  Coordinator  should  evaluate  the 
content  of  the  following  five  courses  in  the  AFIT  CAM 
curriculum  for  their  relevance  to  postgraduate 
contracting/manufacturing  assignments : 

a.  Distribution  Management 

b.  Introduction  to  Computer  (Review  Term) 

c.  Production  and  Maintenance  Management 

d.  Quantitative  Decision  Making 

e.  Statistics  I  and  II 

2.  The  AFIT  CAM  faculty  should  incorporate  more  opportuni¬ 
ties  for  graduate  AFIT  CAM  students  to  practice  public 
speaking . 

3.  The  AFIT  School  of  Systems  and  Logistics  speech  course. 
Speech  for  Military  Managers,  should  become  a  required 
course  for  future  AFIT  CAM  classes.  As  a  minimum,  the 
AFIT  CAM  Option  Coordinator  should  strongly  encourage 
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graduate  students  in  the  AFIT  CAM  program  to  select  the 
Speech  for  Military  Managers  course  as  an  elective. 


4.  Software  Acquisition  and  Small  Business  Contracting 
should  be  included  as  topics  within  the  AFIT  CAM  curri¬ 
culum  in  future  course  offerings. 

5.  The  AFIT  CAM  Option  Coordinator  should  incorporate 
selected  contracting-related  Professional  Continuing 
Education  (PCE)  courses  within  the  AFIT  CAM  curriculum. 
In  particular,  the  following  PCE  courses  should  be  con¬ 
sidered  due  to  their  relatively  short  duration: 

a.  Principles  of  Contract  Pricing 

b.  Contract  Law 

c.  Contract  Negotiation  Workshop 

d.  Contract  Administration 

These  courses  can  be  accomplished  during  the  Review 
Term  by  restructuring  the  current  academic  work  load  or 
by  offering  these  PCE  courses,  as  a  set  of  electives 
in  Winter  or  Spring  Quarters. 

6.  The  AFIT  CAM  Option  Coordinator  should  coordinate  with 
professional  contracting  associations  (i.e..  National 
Contract  Management  Association)  to  provide  future  AFIT 
CAM  students  the  opportunity  to  obtain  a  professional 
contracting  designation. 

Recommendations  for  Future  Research 

The  researchers  suggest  the  following  specific  recom¬ 
mendations  for  future  empirical  research  in  descending  order 
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of  importance: 

1.  For  AFIT  CAM  program  management  purposes,  this  research 
effort  should  be  replicated  during  the  first  year  of  a 
new  AFIT  CAM  Option  Coordinator's  assignment  to  obtain 
current  feedback  from  AFIT  CAM  graduates  and  their 
supervisors  in  the  field. 

2.  Perform  specific  research  to  assess  the  feasibility  of 
incorporating  contracting- related  Professional  Continu¬ 
ing  (PCE)  courses  into  the  graduate  AFIT  CAM  program. 
Issues  addressed  should  include: 

a.  A  comparative  analysis  of  the  AFIT  CAM  curriculum 
with  and  without  incorporation  of  PCE  courses  in 
terms  of  benefits  to  the  Air  Force  contracting/ 
manufacturing  community. 

b.  An  assessment  of  AFIT  faculty  acceptance  and/or 
resistance  to  the  concept  of  incorporating 
contracting- related  PCE  courses  into  the  AFIT  CAM 
curriculum. 

•  c.  An  analysis  of  the  impact  of  incorporating 

contracting- related  PCE  courses  on  AFIT  CAM  pro¬ 
gram  student  workload  and  program  duration. 

d.  An  analysis  of  the  effect  that  incorporation  of 
contracting- related  PCE  courses  into  the  AFIT  CAM 
curriculum  would  have  upon  other  graduate  educa¬ 
tion  programs  at  the  AFIT  School  of  Systems  and 
Logistics . 

3.  Future  follow-on  research  projects  should  develop  a 
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research  methodology  which  will  allow  inferential  pro¬ 
jections  to  the  overall  population  being  surveyed. 

4.  A  research  project  should  be  conducted  to  measure  the 
usefulness  of  the  AFIT  Education  With  Industry  (EWI) 
sponsored  Contracting  and  Manufacturing  Program  as  per¬ 
ceived  by  graduates  and  their  supervisors.  This  project 
should  include  an  evaluation  of  the  quality  and  standard¬ 
ization  of  training  provided  by  the  variety  of  parti¬ 
cipating  defense  contractors. 

5.  Research  projects  similar  to  this  effort  should  be 
conducted  for  other  graduate  education  program  options 
within  the  School  of  Systems  and  Logistics. 

6.  A  parallel  research  project  should  be  performed  to 
measure  the  usefulness  of  the  Naval  Postgraduate  School's 
Acquisition  and  Contract  Management  Program  as  perceived 
by  graduates  and  their  supervisors. 

Final  Thoughts 

As  a  result  of  this  research  effort,  the  authors  have 
shown  that  an  AFIT  CAM  education  is,  indeed,  useful  in  post¬ 
graduate  contracting/manufacturing  assignments.  In  a  larger 
context,  this  research  proved  that  the  AFIT  CAM  program  met 
the  needs  of  the  Air  Force  contracting/manufacturing  community. 
The  practical  value  of  this  research  effort,  however,  is 
contained  in  the  following  areas: 

1.  This  research  provided  real-time  feedback  from  the 
field  regarding  AFIT  CAM  curriculum  currency. 


1 


115 


2.  This  research  provided  the  current  AFIT  CAM  program 
Option  Coordinator  with  a  tool  for  use  in  making  future 
AFIT  CAM  program  management  decisions. 

3.  This  research  provided  sponsors  of  the  AFIT  CAM  program 
with  a  "report  card"  of  the  program's  value  from  the 
users'  point  of  view. 

4.  The  findings  of  this  research  effort  provided  substan¬ 
tial  justification  for  the  continued  existence  of  the 
AFIT  CAM  graduate  program. 
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APPENDIX  A 

THE  GRADUATE  SURVEY  INSTRUMENT 
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DEPARTMENT  OF  THE  AlR  FORCE 

Aifl  FORCE  INSTITUTE  OF  TEChNOIOGV  ATC) 
WRIGHT  PATTERSON  AiR  FORCE  EASE  OH  «S433 


W  *0 

LSH ( LSSR  49  -32/Capt  Wayne / Cap t  Gillette/ AU'OVOS  "35  -  636?) 

w*-,c'  Perceptions  of  the  AFIT  Contracting  Acquisition  Management  (CAM) 
Program  Survey 

<o 


1.  The  AFIT  CAM  Graduate  Program  has  graduated  thirteen  classes 
since  its  inception.  The  research  team  wants  to  ascertain  the 
extent  to  which  the  AFIT  CAM  program  is  meeting  the  on-the-job 
needs  of  the  Air  Force.  The  attached  questionnaire  is  intended 
to  determine  how  past  graduates  and  their  supervisors  feel  about 
the  usefulness  of  the  AFIT  graduate  CAM  program  in  postgraduate 
assignments.  The  survey  has  been  reviewed  and  approved  bv  iir 
University  (AU)  and  has  been  designated  by  AU  Survey  Control 
M umber  32-2:. 


2.  Your  participation  is  entirely  voluntary.  is  a  past  graduate 
of  the  CAM  program,  your  feelings  are  extremely  important.  A 
valid  cross-section  of  attitudes  is  possible  only  with  the 
generous  cooperation  of  participants  like  you. 

3.  Da  not  discuss  your  responses  with  any  other  survey  partici¬ 
pant.  Please  be  candid  in  your  responses! 

4.  Your  participation  in  this  survey  will  be  sincerely  appreciated. 
Be  assured  that  there  will  be  no  attempt  to  pair  vour  responses 
with  those  of  any  other  survey  participant.  The  researchers  are 
interested  only  in  t lie  collective  responses  of  graduates  and 
supervisors,  not  individual  attitudes.  Your  responses  to  the 
questions  will  be  confidential  and  known  only  to  the  researchers. 


S.  Please  return  the  completed  survey- 
addressed  envelope  no  later  than  '  Jun 


acting  Dean'  ! 

V _ School  of  Systems  and 

Logistics 


in  the  enclosed  pre- 
1932  . 


2  Atch 

1.  Survey 

2.  answer  Sheet 


AU  SCN  32-22  (Expires  l  May  1983) 


*l«  *C*Ct  —  l  C»f*t  ***  Of  lift 
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PR IV  \CY  ACT  STATEMENT 


In  accordance  with  paragraph  S,  AFR  12*35,  Air  Force  Privacy  Act 
Program,  the  following  information  is  provided: 

a.  Authority. 

(1)  5  U.S.C.  301,  Departmental  Regulations;  and/or 

(21  10  U.S.C.,  3012,  Secretary  of  the  Air  Force,  Powers, 

Duties,  Delegation  by  Compensation;  ana  or 

(3)'  AFR  30*23,  22  Sep  *6,  Air  Force  Personnel  Survey 

Program. 

b.  Principal  purpose.  This  information  will  be  used  in 
research  aimed  at  providing  inputs  to  the  solution  of  problems 
in  Air  Force  personnel  recruiting  and  retention. 

c.  Routine  uses.  The  survey  data  will  be  converted  to 
information  for  use  in  research  of  management  related  problems. 
Results  of  the” research ,  based  on  the  data  provided,  will  be  in¬ 
cluded  in  written  master's  theses  and  may  also  be  included  in 
published  articles,  reports,  or  texts.  Distribution  of  the 
results  of  the  research,  based  on  the  survey  data,  whether  in 
written  form  or  presented  orally,  will  be  unlimited. 

d.  Participation  in  this  survey  .is  entirely  voluntary. 

e.  No  adverse  action  of  any  kind  may  be  taken  against  anv 
individual  who  elects  not  to  participate  in  any  or  all  of  this 
survey. 
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GENERAL  INSTRUCTIONS 


1.  This  questionnaire  has  three  parts  to  complete.  Each  part 
has  spec* tic  ms truct ions .  Your  responses  to  Part  I,  Part  II, 
and  Part  III  should  be  answered  directly  on  the  questionnaire. 
The  questionnaire  should  be  mailed  back in  the  pre -addressed 
return  envelope. 

2.  XFIT/LSG  and  AFIT/SLG  are  the  same.  Both  denote  the  AFIT 
School  or  Systems  and  Logistics. 

3.  The  terra  AFIT/LSG  Graduate  Contracting  and  Acquisition 
Management  Program  (CAM)  and  AFIT/SLG  Graduate  Logistics  Manage¬ 
ment  with  a  major  in  Procurement  are  the  same. 

4.  Answer  the  questions  only  as  they  relate  to  the  AFIT  School 
of  Systems  and  Logistics  Graduate  Contracting  and  Acquisition 
Management  Program  (CAM) ,  not  other  graduate  education  programs 
you  might  have  attended. 
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PART  t 

DEMOGRAPHICS 


Please  circle  your  answers  to  the  following  questions. 

1.  My  sex  is: 

a.  Male 

b.  Female 

2.  My  present  age  group  is: 

a.  20 - 2 S  vrs. 

b.  16- 30  vrs  . 

c.  31-35  yrs . 

d.  36-iO  yrs. 

e.  41-45  yrs. 

f.  46-50  yrs. 

g.  Over  SO  yrs. 

j.  My  present  rank  is: 

a.  0-1 

b.  0-2 

c.  0-3 

d.  0  4 

e.  0-5 

f.  0-6 

g.  Civilian  (Specify  Grade  3  Step)  _ 

4.  Prior  to  entering  the  AFIT  CAM  program,  I  was  assigned  to: 


a. 

SAC 

h. 

USAFA 

0. 

AFCS 

b. 

TAC 

i. 

USAFE 

p. 

\FLC 

c. 

MAC 

j- 

USAF SO 

<?• 

AFSC 

d. 

ATC 

k. 

USAF5S 

r . 

USAFRED 

e. 

AU 

1. 

AAC 

s . 

Other  (Specify) 

f. 

HQ  USAF 

m. 

ADC 

*■ 

PACAF 

n. 

AFAFC 

Upon  completion 

of 

the  AFIT  CAM 

procram,  I  ua*  issigned 

a. 

SAC 

h. 

USAFA 

o. 

AFCS 

b. 

TAC 

i. 

USAFE 

P- 

AFLC 

c . 

MAC 

j  • 

USAF  SO 

Q  • 

AFSC 

d. 

ATC 

k. 

USAFSS 

r . 

USAFRED 

e . 

vu 

1. 

AAC 

s. 

Other  (Specify) 

t . 

HQ  USAF 

m. 

A0C 

«• 

PACAF 

n. 

AFAFC 
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6.  What  was  'our  grade  when  you  completed  your  Graduate  Contracting 
and  Acquisition  Management  'CAM)  Program’’ 

a,  0-1 

t .  o-: 

c.  0-  J 

d.  0-4 

e.  0-5 

f.  0-6 

g.  Civilian  (Specify  Grade  5  Step)  _ 

7.  When  did  you  graduate  from  the  XFIT'CAM  program’ 


a. 

1981 

e. 

1973A 

i. 

19  “6  A 

m.  19  74B 

b. 

19  SO 

f . 

19'3B 

j  • 

19 '6B 

n.  Have  not  completed 

c. 

19  "9  A 

&• 

197-\ 

k. 

1 9  *  S  A 

program 

d . 

19798 

h. 

19"B 

1. 

19'SB 

The 

level  ot 

mv 

current 

assignment  is: 

a. 

Squadron 

or 

below 

b. 

Croup 

c. 

Wing 

d. 

Air  Division 

e . 

Numbered 

Air 

Force 

f.  Major  Command 

g.  HQ  Air  Force 

h.  Special  Assignments 

9.  I  am  presently  assigned  to: 


a. 

SAC 

h. 

USAFA 

o.  AFCS 

b. 

TAC 

i . 

USAFE 

p.  AFLC 

c. 

MAC 

j  • 

USAFSO 

q.  AFSC 

d. 

ATC 

k. 

USAFSS 

r.  USAF9ED 

e . 

AU 

1. 

AAC 

s.  Other  (Specify) 

f. 

HQ  USAF 

m. 

ADC 

g- 

PACAF 

n. 

AFAFC 

The 

highest 

level 

of  education 

[  attained  is: 

a.  Bachelor's  degree 

b.  Master's  degree 

c.  ''aster's  degree  plus  additional  graduate  work 

d.  ''ore  than  one  Master's  degree 

e.  Doctorate 


My 

current 

dutv 

\FSC  is: 

a. 

:sxx 

h 

6:xx 

o . 

Z'XX 

b. 

30  XX 

i 

6  3  XX 

P- 

29  XX 

c. 

31 XX 

J 

64  XX 

•1* 

55  XX 

d. 

13  XX 

k 

6  5  XX 

r. 

Other 

e . 

46  XX 

l 

66XX 

s . 

Civilian 

f. 

3  1 XX 

m 

6  7\X 

g- 

60  XX 

n 

001X 
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12.  What  is  your  current  6SXX  AFSC* 


a. 

6511 

e . 

6531 

b. 

6516 

f . 

6554 

c . 

6521 

g  • 

Not  currently  in  a  65XX  job 

J. 

6524 

h. 

Civilian 

13.  I  personally  supervise: 

a.  0 

b.  1-5  people 

c.  6  *  10  people 

d.  11-15  people 

e.  16-20  people 

f.  over  20  people 

14.  My  reporting  official  is  well  acquainted  with  both  the 
requirements  of  my  icb  and  my  performance. 

a .  yes 

b .  no 

15.  The  majority  of  my  duty  assignments  since  graduation  have  been 
in  a  contracting  or  procurement  related  field. 

a.  True 

b.  False 

16.  I  have  held  my  present  assignment  for: 

a.  1  yr  or  less 

b.  over  l  yr.  but  less  than  2  yrs. 

c.  over  2  yrs.  but  less  than  3  yrs. 

d.  3  yrs  or  over 

17.  How  many  65XX  or  contracting  related  assignments  have  you  had 
since  graduating  from  the  AFIT  CAM  Program? 

a.  1 

b.  2 

c.  3 

d.  4  or  more 

e.  none 

18.  How  many  years  of  contracting  or  manufacturing  experience  do 
you  currently  have? 

a.  3  yrs  or  less 

b.  over  3  yrs.  but  less  thin  5  vrs. 

c.  over  5  yrs.  but  less  than  8  rs. 

J.  over  3  yrs.  but  less  than  11  yrs. 

e.  over  11  yrs. 

19.  L  am  currently  a: 

a.  Price  \nalyst 

b.  Cost  \nalvst 

c.  Contract  Negotiator 

d.  Contract  specialist 

e.  Principal  Contracting  Officer  vwarranted) 

f.  Administrative  Contracting  Officer  (warranted* 

g.  Manufacturing  tor  Production)  Hficer 

h.  other  (Specify)  ______ 
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20,  What  type  of  contracting  have  you  been  involved  m  since  your 
graduation  from  the  graduate  AFIT  CAM  program'1 


a. 

3ase 

e . 

a  5  b 

b. 

Central 

f. 

a  5  c 

c. 

Systems 

g. 

b  5  c 

d. 

All  of  the  above 

h. 

Other 

21.  Were  you  in  the  contracting  field  prior  to  the  start  of 
your  graduate  program? 

a.  yes  (specify  63XX  AFSC  or  1100/1200  series) _ 

b.  no 

22.  Hois  many  AFIT  Professional  Continuing  Education  (contracting 
related)  courses  have  you  attended  since  your  graduation 
from  the  graduate  AFIT  CAM  Program? 

a .  0 

b.  1 

c.  2 

d.  3 

e.  A  or  more 

23.  Have  you  attended  a  basic  technical  contracting  course  either 
before  or  after  graduation  from  the  graduate  AFIT  CAM  program 
(i.e.,  Lowry  AFB  or  Ft.  Belvoir)? 

a.  yes,  before  graduation 

b.  yes,  after  graduation 

c.  no 

24.  Have  you  published  at  least  one  article  in  a  professional 
journal  since  graduation  from  the  graduate  AFIT  C.AM  program? 

a.  yes  (specify  publication) _ 

b.  no 

IS.  Have  you  obtained  a  professional  contracting  designation 
since  graduation  from  the  graduate  AFIT  CAM  program  (such 
as  NCM.A's  Certified  Professional  Contracts  Manager)? 

a.  yes 

b .  no 
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PART  I! 

PERCEPTIONS 


The  questions  in  this  section  are  concerned  with  the  usefulness 
of  the  graduate  AFIT  CAM  program  and  the  requirements  of  your  post¬ 
graduate  assignments.  If  vou  are  no  longer  in  a  contracting/ 
manufacturing  tvpc  job  I65KX  AFSC)  .  nlease  answer  these  questions 
based  on  the  last  contracting  job  you  held-!  Please  use  the  follow¬ 
ing  response  scale  for  each  question.  PLACE  YOUR  A.NS'-.'ER  ON  THE 
BLANK  SPACE  PROVIDED  NEXT  TO  EACH  QUESTION. 


Strongly 

Disagree  Disagree 
!  I 

Slightly  Undecided/ 
Disagree  Don't  Know 

I  ! 

SI ight ly 
Agree 

Strongly 
Agree  Agree 

1  1 

t  -  r 

a  b 

c  d 

l 

e 

f  * 

16.  I  feel  that  my  graduate  AFIT  CAM  education  is  useful  to 
the  Air  Force. 


27.  I  would  encourage  other  qualified  officers  to  attend  the 
graduate  AFIT  C.AM  program. 

28.  I  feel  that  my  graduate  AFIT  CAM  education  has  enhanced 
my  Air  Force  career. 

29.  I  feel  that  my  graduate  AFIT  C.AM  education  is  useful 
to  my  on-the-job  performance. 


30.  I  feel  that  I  an  better  equipped  to  solve  on-the-job 
problems  because  of  my  graduate  AFIT  CAM  education. 


31.  My  job  requires  the  ability  to  understand  and/or  apply 

mathematical  techniques  beyond  basic  arithmetic  operations. 


32.  My  job  requires  the  ability  to  understand  and  analyte 

accounting  records  and  reports  fsuch  as  fund  coding  system, 
budgets,  cost  center  reports,  allotment  ledgers,  financial 
statements ,  etc. ) . 


33.  My  job  requires  the  ability  to  formally  or  informally 
analyte  existing  organitational  structure  (such  as  work 
flow  patterns,  interpersonal  communications,  etc.). 

34.  My  job  requires  the  understanding  and/or  application  of 
statistical  analysis  concepts  (such  as  in  requirements 
forecasting,  analysis  of  trends,  predicting  the  probability 
of  an  occurrence,  etc.l. 
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Use  the  following  response  scale  for  each  question.  Place  your 
answer  in  the  blank  space  provided  next  to  each  question. 


Strongly  Slightly  Undecided/  Slightly 

Disagree  Disagree  Disagree  Don't  Know  Agree  Agree 

— i - I: - 1 - 1 - ! - i— 


Strongly 

\gree 


g 


35.  My  job  requires  an  understanding  of  the  financial  management 
methods  and  systems  used  by  the  DoD  'such  as  the  Resource 
Management  System,  Programming,  Planning  and  Budgeting 
System,  industrial  funds,  stock  funds,  etc.). 

36.  My  job  requires  the  ability  to  manage  and/or  integrate  the 
various  elements  of  distribution  systems  such  as  base 
supply  systems,  transportation  methods,  order  processing, 
inventory  control,  etc. 

37.  My  job  requires  the  ability  to  manage  or  control  maintenance 
and/or  production  processes  (such  as  scheduling,  component 
assembly,  repair,  etc.). 

38.  My  job  requires  a  knowledge  of  DoD  involvement  in  inter¬ 
national  military  systems  programs  such  as  the  Grant  lid 
Program,  Foreign  Military  Sales  Program,  international 
supply  support  arrangements,  foreign  military  training,  etc. 

39.  My  job  requires  the  ability  to  determine  and/or  evaluate 
the  impact  of  reliability  3nd  maintainability  on  the 
acquisition  and  support  of  weapons  systems  and  their 
components . 

40.  My  job  requires  an  understanding  of  quality  control  concepts 
such  as  specification  compliance,  standardi rat  ion  and 
evaluation  programs,  inspection  routines,  etc. 

41.  My  job  requires  the  ability  to  develop  models  that  will 
allow  evaluating  alternate  courses  of  action  prior  to 
implementation. 

43.  My  job  requires  the  ability  to  understand  the  capabilities 
and  limitations  of  the  computer  as  an  aid  in  the  solution 
of  management  problems. 

43.  My  job  requires  the  ability  to  program  a  computer. 

44.  Mv  job  requires  the  ahilitv  to  understand  and/or  analvre 
org an i rat  tonal  climate  and  the  behavior  of  individuals 
within  that  organization. 
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Use  the  follow ing  response  scale  for  each  question.  Place  your 
answer  in  the  blank  space  provided  next  to  each  question. 


Strongly  Slightly  Undecided/  Slightly  Strongly 

Disagree  Disagree  Disagree  Don’t  Know  Agree  Agree  Agree 


a  b  c  d  erg 


45.  My  job  requires  the  ability  to  verbally  inform,  convince, 
and/or  persuade  individuals  relative  to  ideas,  decisions, 
and  concepts. 

46.  My  job  requires  the  ability  to  conmunicate  in  writing  in 
such  a  manner  as  to  inform,  convince,  and/or  persuade 
individuals  relative  to  ideas,  decisions,  and  concepts  (such 
as  in  the  preparation  of  reports,  correspondence,  etc.). 

47.  My  job  requires  an  understanding  of  economic  concepts 
relating  to  individual  organitations  such  as  marginal  costs, 
time  value  of  money,  market  structures,  etc.  (microeconomic 
concepts)  . 

48.  My  job  requires  an  understanding  of  societal  economic  con¬ 
cepts  such  as  inflation,  gross  national  product,  balance 
of  payments,  etc.  (macroeconomic  concepts). 

_49 .  My  job  requires  the  ability  to  use  and/or  understand 

quantitative  decision-making  techniques  such  as  best  order 
quantity,  transportation  routes  with  the  lowest  cost,  most 
efficient  use  of  available  personnel,  etc. 

50.  My  job  requires  the  ability  to  understand  and  analyte  such 
things  as  the  major  systems  acquisition  process,  market 
envi ronnents ,  logistics  considerations,  financial  arrange¬ 
ments,  and  manufacturing. 

51.  My  job  requires  the  ability  to  understand  or  apply  pricing 
techniques  (such  as  learning  curves,  cost  estimating 
relationships,  cost/price  analysis,  etc.). 

5Z.  My  ;ob  requires  the  abilitv  to  understand  or  ajplv  risk/ 

uncertainty  analysis  in  areas  such  as  Acquisition  Planning, 
Business  Strategy,  Contract  Strategy,  and  negot  i.a  t  ions 

53.  My  job  requires  a  working  knowledge  of  those  lederal  Iiw* 
applicable  in  the  letting  jnd  administration  of  contracts 
(such  as  law  s  /  rcgulat  ions  concerning  competitive  *'iiding, 
use  of  accepted  spec i f icat ions ,  etc.). 

54.  In  ny  job,  it  is  necessary  to  take  into  cons ide rat  ion 
federal  laws,  regulations  or  policies  concerning  social 
and  environmental  related  topics  such  as  ASHA,  Ei'4,  small 
business  subcontracting,  etc. 


127 


Use  the  following  response  scale  tor  each  question.  Place  your 

answer  in  the  blank  space  provided  next  to  each  question. 

Strongly  Slightly  Undecided/  Slightly  Strongly 

Disagree  Disagree  Disagree  Don't  know  Agree  Agree  Agree 

— * - j - t - t - * - t - 1 — 

a  b  c  a  erg 

_ 55.  My  job  requires  a  knowledge  of  contract  management  functions 

such  as  Administrative  Contracting  Officer  responsibilities, 
manufacturing  operations,  subcontract  management,  quality 
assurance,  contract  payment,  overhead  cost  monitorship,  etc. 

56 .  I  am  familiar  with  the  DoD  organizations  for  contract  manage¬ 
ment  li.e.,  AFCMD,  AFCMC,  DC.AS). 

_ 57.  My  job  requires  a  working  knowledge  of  acquisition  management 

subjects  such  as  major  systems  acquisition  policies,  manu¬ 
facturing  management,  the  source  selection  process, 
co-production  management,  contract  modifications,  configura¬ 
tion  management,  fraud,  waste,  and  abuse  in  government 
contracting,  etc. 

_ 53.  My  job  requires  the  ability  to  understand  and/or  analvie 

cost  growth  problems,  project  management,  the  negotiation 
process,  and  acquisition  strategics. 

59 .  My  job  requires  a  working  knowledge  of  the  contract 
administration  process. 

_ 60.  My  job  requires  the  ability  to  understand  and/or  anal; :e 

contractor  proposals  in  such  areas  as  cost  estimation, 
program  scheduling,  contractor  pricing  techniques, 
contractor  accounting  techniques,  etc. 

_ 61.  My  job  requires  a  working  knowledge  of  manufacturing  (or 

production)  related  issues  (such  as  manufacturing 
processes,  computer  aided  Jes ign/oomputer  aid  manu fac tur  ing 
t CAD/CAM),  producib i 1 i tv ,  production  readiness  reviews, 
Manufacturing  Technology/Technology  ''ode rn i tat  ion ,  etc.) 

b Z .  The  skills  that  l  acquired  from  my  \ F I T  r AM  education  have 
proven  useful  in  meeting  the  requirements  of  nv  *'h. 

_ 03.  My  ability  ta  conduct  research  (l.e..  a  thesis')  is  u-efui 

in  performing  my  job. 

_ hi.  Mv  \F  T  T  ’I  AM  education  has  Heen  “t  -ore  value  in  -v  current 

assignment  chan  it  will  he  in  future  assignments. 
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L'se  the  following  response  scale  tor  each  Question,  l  lace  vour 

answer  in  the  blank  space  provided  next  tc  each  question. 

Strongly  Slightly  I'ndec  i  ied/  Slightly  Strongly 

Disagree  Disagree  Disagree  Don't  Know  \gree  \gree  \gree 

— - i - \ - * - t - \ - ; — 

a  b  c  d  e  i  z 

_ ^oS.  My  iFIT  CAM  education  will  be  of  more  value  m  future 

assignments  than  it  has  been  in  ny  current  assignment. 

_ t>6 .  I  reel  that  the  value  of  my  \F  I T  CAM  education  has 

increased  over  time. 

_ 6 T .  I  feel  that  the  incorporation  of  contracting  related 

Professional  Continuing  Education  courses  into  the  graduate 
AFIT  CAM  program  would  improve  the  overall  usefulness  of 
this  program. 

_ o3.  Mv  job  requires  the  abilitv  to  understand  research 

methodologies  and/or  analvre  acquisition  research. 
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APPENDIX  B 

THE  SUPERVISOR  SURVEY  INSTRUMENT 
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DEPARTMENT  OF  THE  AlR  FORCE 
4m  FORCE  NSTJTUTC  OF  TECHNOLOGY  4 TC) 

(V Wight  patterson  air  FORCE  3ASE  Oh  4S4JJ 


.«  LShtLSSR  A9-S2/Capt  ..ayne/Capt  Gillette  VUTOYCN  “3S-o369) 

^*^0  Perceptions  of  the  \FIT  Contracting  Acquisition  Management  (CAM) 
.Program  Survey 


1.  The  AFIT  CAM  Graduate  Program  has  graduated  thirteen  classes 
since  its  inception.  The  research  team  wants  to  ascertain  the 
extent  to  which  the  A F I T  CAM  program  is  meeting  the  on-the-job 
needs  of  the  Air  Force.  The  attached  questionnaire  is  intended 
to  determine  how  past  graduates  and  their  supervisors  reel  about 
the  usefulness  of  the  AF  IT  graduate  CAM  program  in  pcstgracuate 
assignments.  The  survev  has  been  reviewed  and  approved  by  Air 
tfniversit-'  (  AU)  and  has  been  designated  bv  \u  Survev  Control 
Number  82-21. 

2.  Your  participat ion  is  entirely  voluntary.  As  a  current 
supervisor  of  a  CAM  graduate,  your  feelings  are  extremely  import¬ 
ant.  A  valid  cross  -  sect  ion  of  attitudes  is  possible  only  •  ith  the 
generous  cooperation  of  participants  like  you. 

5.  Do  not  discuss  your  responses  with  any  other  survev  partici¬ 
pants.  Please  be  candid  in  your  responses! 

4.  Your  participation  in  t.us  survey  will  be  sincerely  appreciate. 
3e  assured  that  there  will  be  no  attempt  to  pair  your  responses 
with  those  of  any  other  survey  participant.  The  researchers  are 
interested  only  in  the  collective  responses  of  graduates  and 
supervisors  not  individual  attitudes.  Your  responses  te  the 
questions  will  be  confidential  and  known  only  to  the  researchers. 

5.  Please  return  the  completed  survey  in  the  enclosed  pre¬ 
addressed  envelope  no  later  than  ?  Jun  1982. 


2  Vtch 

1 .  Survev 

2.  \n.-wer  Aheet 


U)  aCN  32-21  i Cxpires  l  May  123 3) 


"  v  f-y  /  >>\  ,_■ 

’ eromd  7 .  r*e  r  s ,  Jr. 

Acting  Dean  -  * 

School  of  Systems  and 
x  tog  1 s  tics 


1.1  *C«C8  -*  :»!*T  m  at  2*  I.F6 
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PRIVACY  ACT  STATCMLNT 

In  accordance  with  paragraph  3,  \FR  l*- 35.  Air  Force  Privicv  Vc 
Program,  the  following  information  is  provided: 

a.  Authority. 

(1)  5  U.S.C.  SOI.  Departmental  Regulations,  and, or 

(.2)  10  U.S.C.  .  3012,  Secretary  of  the  iir  Force,  Powers 

Duties,  Delegation  by  Compensation^  and  or 

(3»  AFR  30-  23  ,  22  *%ep  "6,  \ir  Force  Personnel  Survey 
rrocram .  " 


b.  Principal  purpose.  This  information  will  ^e  used  in 
research  aimed  at  providing  inputs  to  the  solution  of  problems 
in  Air  Force  personnel  recruiting  and  retention. 

c.  Routine  uses.  The  survey  data  will  *e  converted  to 
information  for  use  in  research  of  management  related  problems. 
Results  of  the  research,  based  on  the  data  provided,  will  be  in¬ 
cluded  in  written  master's  theses  and  mav  also  be  included  in 
published  articles,  reports,  or  texts.  Distribution  of  the 
results  of  the  research,  based  on  the  survey  data,  whether  in 
written  form  or  presented  orally,  *ill  be  unlimited. 

d.  Participat ion  in  this  survey  is  entirely  voluntary. 

e.  So  idver se  action  of  any  kind  nav  -o  taken  against  inv 
individual  who  elects  not  to  participate  in  any  or  all  of  this 
survey . 


133 


GENERAL  'NSTRL’CTIONS 


1.  This  questionnaire  has  three  parts  to  complete.  Ejcn  part  ha 
specific  instructions.  Your  responses  to  Part  I,  Part  II,  and 
Part  III  should  be  answered  directly  on  the  questionnaire.  The 
questionnaire  should  be  sailed  back  in  the  p re- addres sed  return 
envelope. 

2.  AFIT/LSG  and  1FIT/SLG  are  the  same.  Soth  denote  the  AFIT 
School  of  Systems  and  Logistics. 

J.  The  term  AFIT/LSG  Craduate  Contracting  and  Acquisition  Manage 
sent  Program  (CAM)  ind  AFIT/SLG  Graduate  Logistics  Management 
with  a  major  in  Procurement  are  the  same. 

4.  Answer  the  questions  only  as  they  relate  to  the  AFIT  School 
of  Systems  and  Logistics  Graduate  Contracting  and  Acquisition 
Management  (CAM)  Program,  not  other  graduate  education  programs 
your  subordinate  night  have  attended. 
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PART  l 

DEMOGRAPHICS 

Please  circle  vou r  answers  to  the  following  questions. 

1.  I  am  submitting  this  survey  for  mere  than  cne  AFIT  CAM 
subordinate  under  mv  supervision. 

a.  yes  (specify  *  _ ) 

b .  no 

2.  I  am  >eli  acquainted  *ith  the  requirements  of  my  subordinate's 
; oh  as  veil  as  his 'her  performance. 

a.  yes 

b.  no 

3.  Are  you  a  graduate  of  the  AFIT  School  of  Systems  and  Logistics 
Contracting  and  Acquisition  Management  (CAM)  Program? 

(formerly  known  as  Logistics  Management  with  Procurement  major) 

a.  yes 

b .  no 

4.  I  personally  supervise  the  following  number  of  AFIT  CAM 
graduates. 

a.  1 

b.  : 

c .  3 

d.  4 

e.  other  (specifvl  _ 

PART  II 
PERCEPTION'S 

The  questions  in  this  section  are  concerned  ..ith  the  usefulness  of 
the  AFIT  graduate  Contracting  and  Acquisition  Management  (CAM! 
program  and  the  requirements  of  your  subordinate 1 s  ;ob.  Use  the 
following  response  scale  for  each  question.  Place  your  answer  ir. 
the  blank  space  provided  next  to  each  question. 

itror.glv  slightly  unuecided/  ^lightlv  >trongiv 

Disagree  Disagree  Disagree  Don't  know  Agree  Agree  Agree 

— i - 1 - 1 - l - i - f - ' - 

a  b  c  u  e  t  g 

_ 5.  I  f:el  that  m-  subordinate ' «  'FIT  CW  o  2uc.it  i  on  is  useful 

to  cite  \  i  r  iorce. 

_ o.  I  would  encourage  other  people  wi»o  work  for  .ne  to  if  tend 

the  AFIT  CAM  graduate  program. 
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"$e  the  following  response  scale  for  each  question.  Place  .our 
answer  in  the  blank  space  provided  next  to  each  question. 

Strongly  /lightly  'Jr.decidei/  Slightly  Strongly 

Disagree  Disagree  Disagree  Don’t  Know  Agree  Agree  Agree 

- 1 - - - 1 - 1 - j - ! - ; - 

a  o  c  d  erg 


*.  I  feel  that  mv  subordinate's  VFIT  CAM  education  has  enhanced 
his  or  her  \ir  Force  career. 

_3.  I  reel  that  iv  subordinate ' s  AFIT  CAM  education  is  use- 
fui  to  his  or  her  on-the-job  performance. 

_ 9 .  I  feel  that  my  subordinate  is  better  equipped  to  solve  on- 

the-job  problems  because  of  his  or  her  AFIT  CAM  education. 

10.  My  subordinate’s  job  requires  the  ability  to  understand  and 
analyte  accounting  records  and  reports  (such  as  fund  coding 
system,  budgets,  cost  center  reports,  allotment  ledgers, 
financial  statements,  etc.). 

11.  My  subordinate's  job  requires  the  ability  to  understand 
and/or  apply  mathematical  techniques  bevond  basic  arithmetic 
operations . 

12.  My  subordinate's  job  requires  the  ability  to  use  and/or 
•understand  quantitative  decision-making  techniques  (such 
as  best  order  quantity,  transportation  routes  with  the 
lowest  cost,  most  efficient  use  of  .available  personnel,  etc.). 

13.  My  subordinate's  job  requires  the  ability  to  formally  or 
informally  analyte  existing  o rgani tat ional  structure  (such 
as  work  flow  patterns,  interpersonal  communications,  etc.). 

Id.  My  subordinate’s  job  requires  the  understanding  and/or 

application  of  statistical  analysis  concepts  (such  as  in 
requirements  forecasting,  analysis  of  trends,  predicting 
and  probability  of  an  occurrence,  etc.) 

15.  My  subordinate's  job  requires  an  understanding  of  the 
financial  management  methods  and  svstems  used  hv  the  !'«D 
(such  as  the  Resource  '’anage^ent  /vstem,  Programming, 

Planning  and  budgeting  Sv-stom,  industrial  funds,  stock 
funds  ,  etc . ) . 

16.  Mv  subordinate’s  job  requires  the  ability  to  manage  and/or 
integrate  the  various  elements  of  distribution  sterns 
(such  as  base  supply  systems,  t ransportat ion  methods,  )rder 
processing,  inventory  control,  etc,). 


L’se  Che  following  response  scale  for  each  question.  Place  v:ur 
answer  in  the  ''lank  space  provided  next  to  each  question. 

Strongly  Slightly  Jnutfcided.  alighclv  Strongly 

Disagree  Disagree  Disagree  Don’t  know  \gree  \gree  'gree 


- - * - * — t  '  ‘  -  i - - - - - - p 

3  b  c  d  e  :  g 


1*.  Mv  subordinate ’ s  joo  requires  the  ability  to  manage  or 
control  maintenance  and  or  production  pr?ce>ses  -such  is 
scheduling,  conponent  assembly,  re, air.  etc.). 

13.  My  subordinate’s  job  requires  a  knowledge  :f  DoD  involvement 
in  mternat ional  military  $v«tems  programs  'such  as  the 
drant  Ud  Program,  -oreign  Military  Jales  Program,  inter¬ 
national  supply  support  arrangements  ,  foreign  military 
training,  etc.). 

Mv  surer  Jinate ’s  job  require*  the  ability  to  determine  md/o 
evaluate  the  impact  of  reliability  and  maintainability  an 
the  acquisition  and  support  of  weapons  s  stems  and  their 
components . 

10.  My  subordinate ' s  job  requires  an  understanding  or  quality 
control  concepts  '^such  as  sped  treat  ion  compliance, 
s tandardi cat  ion  and  evaluation  programs,  inspection 
routines  ,  etc.) . 

21.  My  subordinate's  job  requires  the  ability  to  develop  models 
that  will  allow  evaluating  alternate  courses  of  action  prior 
to  implementation. 

21.  My  subordinate's  job  requires  the  ability  to  understand  the 
capabilities  ind  limitations  ot  the  co-puter  as  in  .lid  m 
the  solution  of  nanagement  proolems. 

23.  My  subordinate's  job  requires  the  ability  to  program  a 
computer . 

2  1.  Mv  subordinate ’ s  job  requires  the  ability  to  understand 

ind.'or  analyte  organitationa!  climate  ind  the  ‘'ehavior  'f 
individuals  within  that  organ i :ut ion . 

25.  Mv  subordinate’s  job  requires  the  ability  to  v  c  r  *-  a  1 1  y 

inform,  convince,  and/or  persuade  individuals  relative  to 
ideas,  decisions,  and  concepts. 

25.  Mv  subordinate's  job  requires  the  ibiiitv  to  ;o~r:un  ic ate  m 
writing  in  such  a  manner  as  to  inform,  convince  and/or 
:>e r  W  i  Je  individuals  relatin'  to  ideas,  decisions,  and 
concepts  (such  is  in  t!ie  preparation  of  reports,  corros- 
!*on  iencc ,  etc.'. 
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Use  the  following  response  scale  for  each  question.  Place  your 
answer  in  the  blank  space  provided  next  to  each  question. 


Strongly 

Disagree  Disagree 

•  -  I 

51  ii'itl'.- 

D i sag  ree 

1 

Mndeci Jed/ 
Don ' t  Know 

Slightly  Strcr.glj 

igree  Agree  \gree 

a  b 

c 

j 

<?  *  '& 

My  subordinate's  job 
concepts  relating  to 
marginal  costs,  time 
concepts)  . 


requires  in  understanding  of  economic 
individual  organizations  such  as 
value  of  monev ,  etc.  ^microeconomic 


23.  My  subordinate ' s  job  requires  an  understanding  of  societal 
economic  concepts  such  as  inflation,  gross  national  product, 
balance  of  parents,  etc.  { macroeconomic  concepts'. 


29.  My  subordinate’ s  ability  to  conduct  research  (i.e.,  a 
thesis)  is  useful  in  his/her  job  per  romance. 


30.  My  subordinate's  job  requires  the  ability  to  understand  and 
analyze  such  things  as  the  major  systems  acquisition  pro¬ 
cess,  market  envi ronments ,  logistics  cons  ide r at  ions  , 
financial  arrangements,  and  manufacturing. 


31.  My  subordinate's  job  requires  the  ability  to  understand  or 
apply  pricing  techniques  (such  as  learning  curves,  cost 
estimating  relationships,  cost/price  analvsis,  etc.). 


52.  My  subordinate's  job  requires  the  ability  to  understand  or 
apply  risk/uncertaiatv  analysis  in  areas  such  as  \cquisi- 
tion  Planning,  business  Strategy*  Contract  Strategy  and 
negotiations . 


33.  My  subord inate ' s  job  requires  a  working  knowledge  of  those 
federal  laws  applicable  in  the  letting  and  jdmir.ist  rat  ion 
of  contracts  (such  as  laws-  regulations  concerning  competi¬ 
tive  ^tiding,  use  of  accepted  specifications,  etc.'1. 


34.  In  my  subordinate  s  job,  it  is  necessarv  to  take  into 

cons  iderat ion  federal  laws,  regulations,  ir  policies  con¬ 
cerning  s  -cial  and  environmental  related  t-'nic-  -wv' 

'k-vA  :P\,  s.'-all  business  contracting,  etc. 


53.  '-tv  subordinate  *  s  job  require  a  knowledge  of  contract 

management  functions  such  as  Administrative  Contracting 
•*:  ficer  re  <pcna  ib  1 1 1  f  :os ,  m  ir.uf  actur  i  mg  operation.-, 

*  ibc  'n  ?  r  tc  t  mjnjce^emt.  Mal.ty  assurance  contnct  pay¬ 
ment ,  overhead  : o < t  mcnitorship,  etc. 

3o  .  My  subordinate  is  ti-Mliir  with  the  >r;  in : :  at  \ -n  <  ■  *r 
contract  man.igenent  i.e.,  \KMD,  \Fi  Mi  ,  V  \S  i  . 
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Use  the  following  response  scale  cor  each  question.  Place  vcur 

answer  m  the  '“lank  space  provided  next  to  each  question. 

Strongly  Slightlv  Undecided/  Slightly  Strongly 

Disagree  Disagree  Disagree  Don't  know  Agree  Agree  Agree 

— ; - 1 - * - r - i - t - r - 

a  b  c  >1  e  t  g 

_ 3".  My  subordinate's  ;oh  requires  3  working  knowledge  of  acqui¬ 
sition  management  subjects  such  as  major  sv stems  acquisition 
policies,  manufacturing  management,  the  source  selection 
process,  co-production  management,  contract  modi f icat Lons , 
configuration  management,  fraud,  waste,  and  abuse  in 
government  contracting,  etc. 

_ 3d.  My  subordinate's  job  requires  the  ability  to  understand 

and/or  analyte  cost  growth  problems,  project  management . 
the  negotiation  process,  and  acquisition  strategies. 

_ _ 39.  My  subordinate's  job  requires  a  working  knowledge  of  the 

contract  administration  process. 

_ 40.  My  subordinate's  job  requires  the  ability  to  understand 

and/or  analyze  contractor  proposals  in  such  areas  as  cost 
estimation,  program  scheduling,  contractor  pricing 
techniques,  contractor  accounting  techniques,  etc. 

_ 41.  My  subordinate '  s  job  requires  a  .orkir.g  knowledge  of  manu¬ 
facturing  (or  production)  related  issues  (<uc.a  as  -nanu- 
facturing  processes  computer-aided  des ign/ computer  aid 
manufacturing  'CAD/  CAM),  produc ib  i  1 i tv  ,  production 
readiness  reviews,  etc.). 

_ 42.  The  skills  that  my  subordinate  acquired  from  his  or  her 

AFIT  CAM  education  have  proven  useful  in  meeting  the 
requirements  of  the  job. 

_ 45.  Mv  subordinate  s  job  requires  the  abilit  to  understand 

research  methodologies  and/or  analyte  icquisi tion  research. 

_ 14.  I  feel  that  the  incorporat ion  of  contracting  related 

Professional  Continuing  Ciucation  caur<o<  :  :i  t  m  the 
graduate  \MT  CAM  program  would  improve  tie  over  ill 
usefulness  of  this  pro*;  run. 
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PART  til 

OPEN-ENDED  QUESTIONS 

Please  answer  the  following  questions  in  the  space  provided 
after  each  question. 

d5.  3ased  on  your  field  experience,  what  subject  areas  do 
you  feel  are  important  or  necessitate  enphasis  in  the 
graduate  AFIT  l.\m  curriculum.1 


46. 


Please  list  those  job  related  areas  in  which  you  feel 
that  your  subordinate  is  strongest  and  weakest. 


Strongest 


Weakest 


THANK  YOU  TOR  YOUR  COOPERATION  IN  COMPLETING  THIS 

questionnaire. 

PLEASE  ENCLOSE  THE  QUESTIONNAIRE  IN  THE  RETURN  ENVELOP 
AND  PLACE  T'lE  ENVELOPE  IN  'UTGOINC  OFFICIAL  PI  STR I  PUT  I  ON  . 
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APPENDIX  C 
STATISTICAL  OUTPUT 


141 


TABLE  C-l 


V  t  X  f.  >•  -K 

lie  V  .»• 

M 

f.  *  * 

c 

ft  0 

♦  MM* 

:k 

*  *  * 

*  it 

RES? 

COUNT  I 

SOU  F'CT  I 

RG'J 

COL  F'CT  I 

T  0  1  4L 

TOT  F'LL  I 

1 

.1 

- 

t  r 

16.  I 

1 

7c 

•7  7 

T 

1..3 

I 

?8.7 

i 

i  l  m  7 

i 

2.3 

T 

17.3 

i 

i 

0.2 

i 

1 6  •  b 

i 

- 

- 

- 

• 

27 .  I 

6 

i 

7  1 

i 

7** 

i 

7.3 

T 

92.2 

j 

!•->.? 

I 

16.7 

I 

16.7 

i 

i 

1.3 

I 

IS. 4 

i 

-i- 

-I- 

-i 

23.  I 

1  i 

I 

66 

i 

77 

I 

14.3 

i 

85.7 

i 

16.7 

r 

30 . 6 

1 

1 5 .  S 

1 

* 

2.4 

! 

14.3 

r 

“  I  -* 

- 1  ‘ 

-  i 

*•  v  7 

5 

T 

7“ 

T 

“  7 

i 

o .  5 

T 

93.5 

i 

>6..' 

I 

13.? 

i 

16.? 

r 

i 

1.1 

i 

15.4 

j. 

- 1 

30.  I 

3 

i 

69 

T 

77 

I 

10.4 

i 

89.6 

i 

16.7 

I 

I  '}  ~ 

T 

16.2 

7 

i 

1.7 

T 

14.? 

r 

-I- 

-  j 

62.  I 

T 

77 

r 

6 . 5 

i 

?3. 5 

• 

16.7 

i 

13.? 

i 

Is.  ? 

i 

r 

1.1 

7 

!5.o 

T 

-i-- 

-i- 

—  7 

CULUflM 

36 

42j 

*62 

f'J!  At. 

7.6 

92.2 

s  *./0 .  y 

CM!  SQUARE  --  10.1 2207  ;JITH  5  DEGREES  QF  FREEDOM  SIGNIFICANCE  =  0.0718 
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TABLE  C-2 


******************  CRCSSTA8ULAT1QN  OF 
'  Q  BT  RESP 

*  *  *  *  t  *  *  *  *******  : 


8ESP 


COUNT  I 
SOU  SCI  I 
COL  F'CT  I 
TOT  “CL  I 


I 

T 

I 

-I- 
2? .  I 

I 

T 

i 

-i 

2E.  I 
I 

7 

I 

-i 

29.  I 
I 
I 
I 
-I 
I 
I 
I 
I 
-t 

T 

» 

* 

1 
i 


f;Qjj 

TOTAL 


1.1  2.1 

- r - 1 

0  1  7/1 

0.0  I  100.0  I 
0.0  I  17.3  1 

0.0  i  14.7  I 

- 1 - 1 

2  1  75  I 


i.a 


97.4 


// 

16.7 


77 

>6.7 


11.1  I  14.?  J 
0.4  I  14.2  I 


-I- 

- - 

-T 

2 

I 

75 

I  7? 

2.6 

I 

97.4 

I  14.7 

11.1 

I 

16.9 

I 

9.4 

I 

16.2 

I 

_ _ 

-  *  - 

-I 

30. 


4  1  73  I 

5.2  I  94.8  i 
22.2  I  i 6 . 4  I 
0.9  I  15.8  I 

- 1 . . I 

7  1  70  I 

9.1  I  90.?  i 
25.9  I  13.3  I 


14.7 


77 

16.7 


15.2 


3 

i 

74 

3.9 

i 

9a.  1 

16.7 

i 

lo.7 

y  -  c 

i 

1  i . 

-  T  . 

COLUsIfl 

TOTAL 


18 

3.9 


444 
96. 1 


462 

100.9 


Chi  square  = 


9.71171  WITH  ;  DECREES  OF  FREEL'Ofl  SIGNIFICANCE  *  0.0823 
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TABLE  C-  3 


*  ***************  CROSSTABULATIOrt  0 
0  BY  RESP 

:*********************************** 


RESP 

COUNT  I 

ROU  PCT  I  RGU 

COL  PCT  I  TOTAL 

TOT  PCL  I  t.I  2.1 

Q  . I - 1 - 1 

5.  I  3?  I  2  1  41 

I  95.1  I  4.9  I  16.7 

I  17.3  1  10.0  I 

I  15.9  I  0.8  I 

-I . I — . I 

6.  I  34  I  5  1  41 

I  37.8  I  12.2  I  16.7 

I  15.9  1  25.0  1 

I  14.6  I  2.0  I 

-1 . 1 . 1 

7.  I  38  I  3  1  41 

1  92.7  1  7.3  I  16.7 

1  16.8  1  15.0  I 

I  15.4  I  1.2  I 

-I . I . I 

8.  1  33  I  3  1  41 

I  92.7  I  7.3  I  16.7 

I  16.8  I  15.0  I 

I  15.4  I  1.2  I 

-I . -I— . I 

9.  I  37  I  41  41 

I  90.2  I  9.8  I  16.7 

I  14.4  I  20.0  I 

I  15.0  I  1.6  I 

-l— . 1 . 1 

42.  I  38  I  31  41 

I  92.7  I  7.3  I  16.7 

I  16.8  1  15.0  I 

I  15.4  I  1.2  I 

-I . I - 1 

COLUrtN  226  20  246 

TOTAL  91.9  3.1  100.0 

CHI  SQUARE  =  1.74159  UITH  5  DEGREES  OF  FREEI'OH  SIGNIFICANCE  * 


F 

*  < 


0.3836 
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TABLE  C-4 


1 


********  **********  CROSSTABULiiTIOfl  OF 
Q  BY  RESf 

it************************************* 

RESP 

COUNT  I 

ROU  PCT  I  ROU 

COL  PCT  I  TOTAL 

TOT  PCL  I  1.1  2.1 

Q  . I - 1 - 1 

5.  I  0  1  11  I  41 

I  0.0  I  100.0  I  16.7 

I  0.0  I  16.9  I 

I  0.0  I  16.7  I 

-I . —I - 1 

6.  I  11  40  !  41 

1  2.4  I  97.6  I  IS. 7 

J  25.0  I  16.5  I 

I  0.4  I  16.3  I 

-I . I- . I 

7.  I  0  1  41  I  41 

I  0.0  I  100.0  I  16.7 

1  0.0  I  16.9  I 

I  0.0  I  16.7  I 


-I- 

-I- 

-I 

I 

i 

I 

40 

I 

41 

I 

2.4 

I 

97.6 

I 

16.7 

I 

25.0 

I 

16.5 

I 

I 

0.4 

I 

16.3 

I 

-  T  - 

—  T  — 

-T 

9.  I  II  40  I  41 

I  2.4  I  97.6  I  16.7 

I  25.0  I  16.5  I 

I  0.4  I  16.3  I 

-I . -I- . —  I 

42.  I  II  40  1  41 

I  2.4  I  97.6  I  16.7 

I  25.0  I  16.5  I 

I  0.4  I  16.3  I 

-I . —I . I 

COLUMN  4  242  246 

TOTAL  1.6  98.4  100.0 


CHI  SQUARE  *  2.03306  UITH  5  DEGREES  OF  FREEDOH  SIDNIFICAMCE  =  0.8446 
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TABLE  C-5 


U1LC0X0N  nATCHED-PfllRS  SlGNED-RAKKS  TEST 


0  - PMK B  74  +RANKS 

TIES  REAM  MEAN 

\  0.00  58. SO 


Z 

-7.574 


Results:  Research  Hypothesis  One 


TABLE  C-6 


UlLCQXQH  MTCHED-PfitfS  SIGHED-RANKS  TEST 


1  -RAM S  3?  *RANK5 

TIES  WEAK  HE AH 

I  l  .00  2K 00 


1 

-5.497 


Results:  Research  Hypothesis  Two 


TABLE  C-7 


- NANN-VH1TNEY  U  -  UILCOXON  RANK  SUrt  U  TEST 

T 

Bt  R 

R  I.  P.  2. 

HERN  RANK  WUMEEF;  MEAN  RANK  NL'/lBER 

58 . 3  A  77  61.68  41 

CORRECTED  FDR  TIES 
_U  U  1  2-TAILED  P 

1469. 0  2S29.0  -0.5078  0.&116 


Results:  Research  Hypothesis  Three 


TABLE  C-8 


SPEARHAN  CORRELATION  COEFFICIENTS 

VARIABLE 

PAIR 


SCORE  0.0410 
UITH  N(  77) 
YEAR  SI6  .362 


Results:  Research  Hypothesis  Four 
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